[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:33:41 dist-test-slave-601b krb5kdc[9468](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:33:41 dist-test-slave-601b krb5kdc[9468](info): set up 2 sockets
Sep 29 06:33:41 dist-test-slave-601b krb5kdc[9468](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260929 06:33:42.232723 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.015s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:33:42 dist-test-slave-601b krb5kdc[9468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:33:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:33:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:33:42.362169 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:45227
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:42467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:45227
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:42.441797 9481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:42.442000 9481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:42.442022 9481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:42.443171 9481 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:33:42.443212 9481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:42.443226 9481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:42.443239 9481 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:33:42.443251 9481 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:33:42.444813 9481 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:42467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:45227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:45227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:42.445056 9481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:42.445289 9481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:42.450054 9489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:42.450064 9487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:42.450074 9486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:42.450467 9481 server_base.cc:1034] running on GCE node
I20260929 06:33:42.450721 9481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:42.450970 9481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:42.452106 9481 hybrid_clock.cc:648] HybridClock initialized: now 1790663622452066 us; error 53 us; skew 500 ppm
Sep 29 06:33:42 dist-test-slave-601b krb5kdc[9468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663622, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:42.454530 9481 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:33:42.454988 9481 webserver.cc:460] Webserver started at http://127.9.61.126:43697/ using document root <none> and password file <none>
I20260929 06:33:42.455183 9481 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:42.455222 9481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:42.455312 9481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:42.456386 9481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "e7f7d96919c14e57bba7aa1fabfb67c3"
format_stamp: "Formatted at 2026-09-29 06:33:42 on dist-test-slave-601b"
server_key: "e11c33f11e38c56fed1943c04e11cd74"
server_key_iv: "0453b4cb974c04fa31c86c8895d3ea07"
server_key_version: "encryptionkey@0"
I20260929 06:33:42.456761 9481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "e7f7d96919c14e57bba7aa1fabfb67c3"
format_stamp: "Formatted at 2026-09-29 06:33:42 on dist-test-slave-601b"
server_key: "e11c33f11e38c56fed1943c04e11cd74"
server_key_iv: "0453b4cb974c04fa31c86c8895d3ea07"
server_key_version: "encryptionkey@0"
I20260929 06:33:42.458084 9481 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:33:42.458796 9496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:42.458966 9481 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:42.459064 9481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "e7f7d96919c14e57bba7aa1fabfb67c3"
format_stamp: "Formatted at 2026-09-29 06:33:42 on dist-test-slave-601b"
server_key: "e11c33f11e38c56fed1943c04e11cd74"
server_key_iv: "0453b4cb974c04fa31c86c8895d3ea07"
server_key_version: "encryptionkey@0"
I20260929 06:33:42.459136 9481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:42.488063 9481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:42.490011 9481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:42.490175 9481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:42.494421 9481 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:45227
I20260929 06:33:42.494457 9548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:45227 every 8 connection(s)
I20260929 06:33:42.494828 9481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:33:42.495692 9549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:42.497459 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 9481
I20260929 06:33:42.497576 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:33:42.498364 9461 external_mini_cluster.cc:1428] Setting key cb3619db3412ef45c73369ea643be75e
I20260929 06:33:42.498497 9549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3: Bootstrap starting.
I20260929 06:33:42.499217 9549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:42.499564 9549 log.cc:824] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:42.500296 9549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3: No bootstrap required, opened a new log
I20260929 06:33:42.502193 9549 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f7d96919c14e57bba7aa1fabfb67c3" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45227 } }
I20260929 06:33:42.502351 9549 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:42.502398 9549 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f7d96919c14e57bba7aa1fabfb67c3, State: Initialized, Role: FOLLOWER
I20260929 06:33:42.502529 9549 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f7d96919c14e57bba7aa1fabfb67c3" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45227 } }
I20260929 06:33:42.502624 9549 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:33:42.502667 9549 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:33:42.502713 9549 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:42.503582 9549 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f7d96919c14e57bba7aa1fabfb67c3" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45227 } }
I20260929 06:33:42.503683 9549 leader_election.cc:302] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7f7d96919c14e57bba7aa1fabfb67c3; no voters:
I20260929 06:33:42.503830 9549 leader_election.cc:288] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:33:42.503881 9554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:42.504057 9554 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [term 1 LEADER]: Becoming Leader. State: Replica: e7f7d96919c14e57bba7aa1fabfb67c3, State: Running, Role: LEADER
I20260929 06:33:42.504093 9549 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:33:42.504189 9554 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f7d96919c14e57bba7aa1fabfb67c3" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45227 } }
I20260929 06:33:42.504626 9554 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7f7d96919c14e57bba7aa1fabfb67c3. Latest consensus state: current_term: 1 leader_uuid: "e7f7d96919c14e57bba7aa1fabfb67c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f7d96919c14e57bba7aa1fabfb67c3" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45227 } } }
I20260929 06:33:42.504645 9555 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7f7d96919c14e57bba7aa1fabfb67c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f7d96919c14e57bba7aa1fabfb67c3" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45227 } } }
I20260929 06:33:42.504773 9554 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [sys.catalog]: This master's current role is: LEADER
I20260929 06:33:42.504782 9555 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3 [sys.catalog]: This master's current role is: LEADER
I20260929 06:33:42.505029 9563 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:33:42.505528 9563 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:33:42.509001 9563 catalog_manager.cc:1347] Generated new cluster ID: be20d3f49e1840dc906f296aa90a487c
I20260929 06:33:42.509055 9563 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:33:42 dist-test-slave-601b krb5kdc[9468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:42.514307 9551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:42.499280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34496 (local address 127.9.61.126:45227)
0929 06:33:42.499480 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:42.499490 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:42.499704 (+ 214us) server_negotiation.cc:407] Connection header received
0929 06:33:42.501779 (+ 2075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:42.501787 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:42.501843 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:42.502008 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:42.503601 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.505082 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.506459 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.507038 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.507153 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:42.510912 (+ 3759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:42.510916 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:42.510916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:42.510927 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:42.512665 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:42.513056 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:42.513058 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:42.513059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:42.513153 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:42.513375 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:42.513375 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:42.513376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:42.513644 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:42.513773 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:42.513983 (+ 210us) server_negotiation.cc:299] Negotiation successful
0929 06:33:42.514104 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":72,"threads_started":1}
I20260929 06:33:42.518419 9563 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:33:42.519083 9563 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:33:42.525096 9563 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7f7d96919c14e57bba7aa1fabfb67c3: Generated new TSK 0
I20260929 06:33:42.525287 9563 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:33:42.554458 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45227
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:42467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:42.635501 9575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:42.635702 9575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:42.635725 9575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:42.636932 9575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:42.636973 9575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:42.637001 9575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:33:42.638411 9575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:42467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45227
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:42.638693 9575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:42.638937 9575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:42.643930 9583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:42.643927 9581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:42.643991 9580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:42.643975 9575 server_base.cc:1034] running on GCE node
I20260929 06:33:42.644394 9575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:42.644584 9575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:42.645730 9575 hybrid_clock.cc:648] HybridClock initialized: now 1790663622645701 us; error 41 us; skew 500 ppm
Sep 29 06:33:42 dist-test-slave-601b krb5kdc[9468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663622, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:42.648200 9575 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:33:42.648609 9575 webserver.cc:460] Webserver started at http://127.9.61.65:45391/ using document root <none> and password file <none>
I20260929 06:33:42.648841 9575 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:42.648911 9575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:42.649063 9575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:42.650074 9575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "336f3e92e0e246a1a32a56e953dbd4d0"
format_stamp: "Formatted at 2026-09-29 06:33:42 on dist-test-slave-601b"
server_key: "6f9718fc04de021c065796bb511f22c6"
server_key_iv: "198ecb87d6e70e4a0e23759524af6daa"
server_key_version: "encryptionkey@0"
I20260929 06:33:42.650431 9575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "336f3e92e0e246a1a32a56e953dbd4d0"
format_stamp: "Formatted at 2026-09-29 06:33:42 on dist-test-slave-601b"
server_key: "6f9718fc04de021c065796bb511f22c6"
server_key_iv: "198ecb87d6e70e4a0e23759524af6daa"
server_key_version: "encryptionkey@0"
I20260929 06:33:42.651731 9575 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:33:42.652530 9590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:42.652705 9575 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:42.652802 9575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "336f3e92e0e246a1a32a56e953dbd4d0"
format_stamp: "Formatted at 2026-09-29 06:33:42 on dist-test-slave-601b"
server_key: "6f9718fc04de021c065796bb511f22c6"
server_key_iv: "198ecb87d6e70e4a0e23759524af6daa"
server_key_version: "encryptionkey@0"
I20260929 06:33:42.652889 9575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:42.669997 9575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:42.672398 9575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:42.672561 9575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:42.672808 9575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:42.673108 9575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:42.673162 9575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:42.673204 9575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:42.673229 9575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:42.679010 9575 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:46651
I20260929 06:33:42.679114 9703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:46651 every 8 connection(s)
I20260929 06:33:42.679486 9575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:33:42 dist-test-slave-601b krb5kdc[9468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663622, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:42.689301 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 9575
I20260929 06:33:42.689416 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:33:42.689584 9461 external_mini_cluster.cc:1428] Setting key 45bd32d62ef428362c7dbc917b3508ec
I20260929 06:33:42.690092 9551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:42.680270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:48209 (local address 127.9.61.126:45227)
0929 06:33:42.680357 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:42.680360 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:42.680538 (+ 178us) server_negotiation.cc:407] Connection header received
0929 06:33:42.681084 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:42.681086 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:42.681099 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:42.681144 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:42.682105 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.682615 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.683615 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.683908 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.684025 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:42.686946 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:42.686948 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:42.686948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:42.686956 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:42.688517 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:42.688942 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:42.688943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:42.688944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:42.689006 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:42.689276 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:42.689277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:42.689277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:42.689396 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:42.689476 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:42.689891 (+ 415us) server_negotiation.cc:299] Negotiation successful
0929 06:33:42.689997 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 06:33:42.690217 9706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:42.680232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45227 (local address 127.9.61.65:48209)
0929 06:33:42.680418 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:42.680453 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:42.680969 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:42.681243 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:42.681246 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:42.681809 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:42.682001 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:42.682006 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.682733 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.682734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:42.683524 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:42.683526 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.684036 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.684037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:42.684266 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:42.684892 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:42.684902 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:42.686827 (+ 1925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:42.688616 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:42.688622 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:42.688625 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:42.688851 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:42.689072 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:42.689073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:42.689074 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:42.689192 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:42.689490 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:42.689497 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:42.689707 (+ 210us) client_negotiation.cc:769] Sending connection context
0929 06:33:42.689845 (+ 138us) client_negotiation.cc:240] Negotiation successful
0929 06:33:42.690033 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":78,"threads_started":1}
I20260929 06:33:42.690661 9704 heartbeater.cc:347] Connected to a master server at 127.9.61.126:45227
I20260929 06:33:42.690784 9704 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:42.690959 9704 heartbeater.cc:511] Master 127.9.61.126:45227 requested a full tablet report, sending...
I20260929 06:33:42.691496 9513 ts_manager.cc:194] Registered new tserver with Master: 336f3e92e0e246a1a32a56e953dbd4d0 (127.9.61.65:46651)
I20260929 06:33:42.692471 9513 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:48209
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:33:42.714074 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45227
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:42467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:42.794709 9709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:42.794922 9709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:42.794946 9709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:42.796121 9709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:42.796162 9709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:42.796191 9709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:33:42.797570 9709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:42467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45227
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9709
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:42.797761 9709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:42.797938 9709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:42.802783 9714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:42.802981 9709 server_base.cc:1034] running on GCE node
W20260929 06:33:42.802793 9715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:42.802815 9717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:42.803246 9709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:42.803443 9709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:42.804579 9709 hybrid_clock.cc:648] HybridClock initialized: now 1790663622804567 us; error 29 us; skew 500 ppm
Sep 29 06:33:42 dist-test-slave-601b krb5kdc[9468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663622, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:42.807098 9709 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:33:42.807482 9709 webserver.cc:460] Webserver started at http://127.9.61.66:40711/ using document root <none> and password file <none>
I20260929 06:33:42.807657 9709 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:42.807698 9709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:42.807793 9709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:42.808917 9709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "a4d44ebbc3a84a34b6eb5a25309abfa0"
format_stamp: "Formatted at 2026-09-29 06:33:42 on dist-test-slave-601b"
server_key: "1940e689fe126936f8498b7edfc1900d"
server_key_iv: "5a39a0dbd9da2a78b30d4bb8be13ab32"
server_key_version: "encryptionkey@0"
I20260929 06:33:42.809207 9709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "a4d44ebbc3a84a34b6eb5a25309abfa0"
format_stamp: "Formatted at 2026-09-29 06:33:42 on dist-test-slave-601b"
server_key: "1940e689fe126936f8498b7edfc1900d"
server_key_iv: "5a39a0dbd9da2a78b30d4bb8be13ab32"
server_key_version: "encryptionkey@0"
I20260929 06:33:42.810472 9709 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:33:42.811146 9724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:42.811324 9709 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:42.811452 9709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "a4d44ebbc3a84a34b6eb5a25309abfa0"
format_stamp: "Formatted at 2026-09-29 06:33:42 on dist-test-slave-601b"
server_key: "1940e689fe126936f8498b7edfc1900d"
server_key_iv: "5a39a0dbd9da2a78b30d4bb8be13ab32"
server_key_version: "encryptionkey@0"
I20260929 06:33:42.811529 9709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:42.832639 9709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:42.834697 9709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:42.834867 9709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:42.835119 9709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:42.835428 9709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:42.835481 9709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:42.835521 9709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:42.835551 9709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:42.841881 9709 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:41771
I20260929 06:33:42.841924 9837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:41771 every 8 connection(s)
I20260929 06:33:42.842271 9709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:33:42 dist-test-slave-601b krb5kdc[9468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663622, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:42.849099 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 9709
I20260929 06:33:42.849220 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:33:42.849404 9461 external_mini_cluster.cc:1428] Setting key 336acca3d438431cd263a154f5ebba27
I20260929 06:33:42.851593 9551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:42.843009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:59965 (local address 127.9.61.126:45227)
0929 06:33:42.843078 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:42.843080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:42.843296 (+ 216us) server_negotiation.cc:407] Connection header received
0929 06:33:42.843767 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:42.843768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:42.843777 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:42.843838 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:42.844803 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.845333 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.846272 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.846486 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.846548 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:42.848648 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:42.848650 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:42.848650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:42.848656 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:42.850266 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:42.850642 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:42.850643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:42.850644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:42.850709 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:42.850929 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:42.850930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:42.850930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:42.851072 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:42.851141 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:42.851369 (+ 228us) server_negotiation.cc:299] Negotiation successful
0929 06:33:42.851460 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:33:42.851759 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:42.842981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45227 (local address 127.9.61.66:59965)
0929 06:33:42.843156 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:42.843196 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:42.843686 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:42.843891 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:42.843894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:42.844535 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:42.844722 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:42.844727 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.845412 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.845413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:42.846190 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:42.846192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.846563 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.846564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:42.846659 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:42.847099 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:42.847106 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:42.848553 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:42.850348 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:42.850353 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:42.850355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:42.850565 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:42.850775 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:42.850776 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:42.850776 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:42.850868 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:42.851134 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:42.851138 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:42.851248 (+ 110us) client_negotiation.cc:769] Sending connection context
0929 06:33:42.851328 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 06:33:42.851485 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":101,"threads_started":1}
I20260929 06:33:42.852166 9838 heartbeater.cc:347] Connected to a master server at 127.9.61.126:45227
I20260929 06:33:42.852277 9838 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:42.852447 9838 heartbeater.cc:511] Master 127.9.61.126:45227 requested a full tablet report, sending...
I20260929 06:33:42.852839 9513 ts_manager.cc:194] Registered new tserver with Master: a4d44ebbc3a84a34b6eb5a25309abfa0 (127.9.61.66:41771)
I20260929 06:33:42.853220 9513 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:59965
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:33:42.872637 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45227
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:42467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:42.953574 9843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:42.953769 9843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:42.953792 9843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:42.954917 9843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:42.954957 9843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:42.955013 9843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:33:42.956561 9843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:42467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45227
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:42.956804 9843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:42.957039 9843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:42.962095 9849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:42.962152 9851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:42.962186 9843 server_base.cc:1034] running on GCE node
W20260929 06:33:42.962105 9848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:42.962503 9843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:42.962697 9843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:42.963863 9843 hybrid_clock.cc:648] HybridClock initialized: now 1790663622963865 us; error 44 us; skew 500 ppm
Sep 29 06:33:42 dist-test-slave-601b krb5kdc[9468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663622, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:42.966261 9843 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:33:42.966706 9843 webserver.cc:460] Webserver started at http://127.9.61.67:43487/ using document root <none> and password file <none>
I20260929 06:33:42.966971 9843 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:42.967038 9843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:42.967178 9843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:42.968628 9843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "29449b362ba94d81ba01d4c5851b736f"
format_stamp: "Formatted at 2026-09-29 06:33:42 on dist-test-slave-601b"
server_key: "a7a11c5db055a5363b4a4496c3368736"
server_key_iv: "88ce1a9d086818c7a77fd6000a094957"
server_key_version: "encryptionkey@0"
I20260929 06:33:42.969046 9843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "29449b362ba94d81ba01d4c5851b736f"
format_stamp: "Formatted at 2026-09-29 06:33:42 on dist-test-slave-601b"
server_key: "a7a11c5db055a5363b4a4496c3368736"
server_key_iv: "88ce1a9d086818c7a77fd6000a094957"
server_key_version: "encryptionkey@0"
I20260929 06:33:42.970323 9843 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:33:42.971016 9858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:42.971189 9843 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:42.971288 9843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "29449b362ba94d81ba01d4c5851b736f"
format_stamp: "Formatted at 2026-09-29 06:33:42 on dist-test-slave-601b"
server_key: "a7a11c5db055a5363b4a4496c3368736"
server_key_iv: "88ce1a9d086818c7a77fd6000a094957"
server_key_version: "encryptionkey@0"
I20260929 06:33:42.971374 9843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:42.983662 9843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:42.985555 9843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:42.985723 9843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:42.985949 9843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:42.986263 9843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:42.986317 9843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:42.986357 9843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:42.986384 9843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:42.992193 9843 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:42165
I20260929 06:33:42.992250 9971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:42165 every 8 connection(s)
I20260929 06:33:42.992591 9843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:33:42.997335 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 9843
I20260929 06:33:42.997434 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:33:42.997625 9461 external_mini_cluster.cc:1428] Setting key 8d8b36779a7f8f1c11606ebce91cad1c
Sep 29 06:33:42 dist-test-slave-601b krb5kdc[9468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663622, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:43.001817 9551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:42.993333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:50015 (local address 127.9.61.126:45227)
0929 06:33:42.993404 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:42.993406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:42.993570 (+ 164us) server_negotiation.cc:407] Connection header received
0929 06:33:42.994031 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:42.994032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:42.994041 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:42.994096 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:42.994970 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.995530 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.996505 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.996679 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.996734 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:42.999211 (+ 2477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:42.999212 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:42.999213 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:42.999220 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:43.000625 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:43.000987 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:43.000988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:43.000988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:43.001039 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:43.001249 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:43.001250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:43.001250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:43.001346 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:43.001398 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:43.001694 (+ 296us) server_negotiation.cc:299] Negotiation successful
0929 06:33:43.001756 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 06:33:43.002028 9974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:42.993290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45227 (local address 127.9.61.67:50015)
0929 06:33:42.993446 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:42.993487 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:42.993954 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:42.994153 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:42.994156 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:42.994698 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:42.994881 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:42.994886 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.995610 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.995611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:42.996434 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:42.996436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:42.996754 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:42.996755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:42.996850 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:42.997391 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:42.997419 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:42.999124 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:43.000698 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:43.000704 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:43.000705 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:43.000916 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:43.001094 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:43.001094 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:43.001095 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:43.001196 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:43.001429 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:43.001435 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:43.001557 (+ 122us) client_negotiation.cc:769] Sending connection context
0929 06:33:43.001665 (+ 108us) client_negotiation.cc:240] Negotiation successful
0929 06:33:43.001790 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260929 06:33:43.002539 9972 heartbeater.cc:347] Connected to a master server at 127.9.61.126:45227
I20260929 06:33:43.002621 9972 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:43.002754 9972 heartbeater.cc:511] Master 127.9.61.126:45227 requested a full tablet report, sending...
I20260929 06:33:43.003089 9513 ts_manager.cc:194] Registered new tserver with Master: 29449b362ba94d81ba01d4c5851b736f (127.9.61.67:42165)
I20260929 06:33:43.003490 9513 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:50015
I20260929 06:33:43.009568 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 06:33:43 dist-test-slave-601b krb5kdc[9468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663623, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 06:33:43 dist-test-slave-601b krb5kdc[9468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663623, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.61.65@KRBTEST.COM
I20260929 06:33:43.032840 9979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:43.024931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35136 (local address 127.9.61.65:46651)
0929 06:33:43.025246 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:43.025252 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:43.025264 (+ 12us) server_negotiation.cc:407] Connection header received
0929 06:33:43.025298 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:43.025300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:43.025314 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:43.025404 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:43.025983 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:43.026715 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:43.027481 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:43.027805 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:43.027890 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:43.030110 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:43.030121 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:43.030121 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:43.030133 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:43.031563 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:43.031979 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:43.031983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:43.031983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:43.032064 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:43.032272 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:43.032273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:43.032273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:43.032414 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:43.032564 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:43.032635 (+ 71us) server_negotiation.cc:299] Negotiation successful
0929 06:33:43.032719 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":98,"threads_started":1}
W20260929 06:33:43.033218 9618 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35136
Sep 29 06:33:43 dist-test-slave-601b krb5kdc[9468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663623, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 06:33:43 dist-test-slave-601b krb5kdc[9468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663623, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.65@KRBTEST.COM
I20260929 06:33:43.055519 9979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:43.048537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35150 (local address 127.9.61.65:46651)
0929 06:33:43.048613 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:43.048615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:43.048707 (+ 92us) server_negotiation.cc:407] Connection header received
0929 06:33:43.048822 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:43.048823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:43.048836 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:43.048906 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:43.049479 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:43.049966 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:43.050691 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:43.050901 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:43.050987 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:43.053205 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:43.053207 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:43.053207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:43.053215 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:43.054643 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:43.054931 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:43.054932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:43.054933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:43.054989 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:43.055128 (+ 139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:43.055128 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:43.055128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:43.055237 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:43.055324 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:43.055392 (+ 68us) server_negotiation.cc:299] Negotiation successful
0929 06:33:43.055454 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260929 06:33:43.056152 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 9575
I20260929 06:33:43.060382 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 9709
I20260929 06:33:43.064654 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 9843
I20260929 06:33:43.068878 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 9481
2026-09-29T06:33:43Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1876 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:33:43 dist-test-slave-601b krb5kdc[9986](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:33:43 dist-test-slave-601b krb5kdc[9986](info): set up 2 sockets
Sep 29 06:33:43 dist-test-slave-601b krb5kdc[9986](info): commencing operation
krb5kdc: starting...
W20260929 06:33:44.095541 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.006s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:33:44 dist-test-slave-601b krb5kdc[9986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:33:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:33:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:33:44.212776 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:45223
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:45223
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:44.294292 9999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:44.294515 9999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:44.294539 9999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:44.295634 9999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:33:44.295667 9999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:44.295681 9999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:44.295693 9999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:33:44.295706 9999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:33:44.297159 9999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:45223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:45223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:44.297379 9999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:44.297559 9999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:44.302413 10007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:44.302423 10005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:44.302425 10004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:44.302716 9999 server_base.cc:1034] running on GCE node
I20260929 06:33:44.303011 9999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:44.303316 9999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:44.304478 9999 hybrid_clock.cc:648] HybridClock initialized: now 1790663624304458 us; error 52 us; skew 500 ppm
Sep 29 06:33:44 dist-test-slave-601b krb5kdc[9986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663624, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:44.306998 9999 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:33:44.307502 9999 webserver.cc:460] Webserver started at http://127.9.61.126:45345/ using document root <none> and password file <none>
I20260929 06:33:44.307734 9999 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:44.307804 9999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:44.308007 9999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:44.309098 9999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "59b371cadbb84bfe8ffe20fb018ad0d4"
format_stamp: "Formatted at 2026-09-29 06:33:44 on dist-test-slave-601b"
server_key: "19cb49b1fbad4084dec3f790ff72d35a"
server_key_iv: "7621ee537c7ecb30ed98556177108f17"
server_key_version: "encryptionkey@0"
I20260929 06:33:44.309489 9999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "59b371cadbb84bfe8ffe20fb018ad0d4"
format_stamp: "Formatted at 2026-09-29 06:33:44 on dist-test-slave-601b"
server_key: "19cb49b1fbad4084dec3f790ff72d35a"
server_key_iv: "7621ee537c7ecb30ed98556177108f17"
server_key_version: "encryptionkey@0"
I20260929 06:33:44.310853 9999 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:33:44.311581 10014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:44.311769 9999 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:44.311872 9999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "59b371cadbb84bfe8ffe20fb018ad0d4"
format_stamp: "Formatted at 2026-09-29 06:33:44 on dist-test-slave-601b"
server_key: "19cb49b1fbad4084dec3f790ff72d35a"
server_key_iv: "7621ee537c7ecb30ed98556177108f17"
server_key_version: "encryptionkey@0"
I20260929 06:33:44.312000 9999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:44.335275 9999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:44.337230 9999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:44.337414 9999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:44.341543 9999 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:45223
I20260929 06:33:44.341588 10066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:45223 every 8 connection(s)
I20260929 06:33:44.341969 9999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:33:44.342801 10067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:44.345180 10067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4: Bootstrap starting.
I20260929 06:33:44.345784 10067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:44.346082 10067 log.cc:824] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:44.346787 10067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4: No bootstrap required, opened a new log
I20260929 06:33:44.347755 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 9999
I20260929 06:33:44.347848 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:33:44.348028 9461 external_mini_cluster.cc:1428] Setting key 33e1639bd1876aaef4e9ddbad558f970
I20260929 06:33:44.348973 10067 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59b371cadbb84bfe8ffe20fb018ad0d4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45223 } }
I20260929 06:33:44.349161 10067 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:44.349202 10067 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b371cadbb84bfe8ffe20fb018ad0d4, State: Initialized, Role: FOLLOWER
I20260929 06:33:44.349340 10067 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59b371cadbb84bfe8ffe20fb018ad0d4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45223 } }
I20260929 06:33:44.349426 10067 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:33:44.349460 10067 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:33:44.349515 10067 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:44.350445 10067 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59b371cadbb84bfe8ffe20fb018ad0d4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45223 } }
I20260929 06:33:44.350530 10067 leader_election.cc:302] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59b371cadbb84bfe8ffe20fb018ad0d4; no voters:
I20260929 06:33:44.350700 10067 leader_election.cc:288] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:33:44.350729 10072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:44.350855 10072 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [term 1 LEADER]: Becoming Leader. State: Replica: 59b371cadbb84bfe8ffe20fb018ad0d4, State: Running, Role: LEADER
I20260929 06:33:44.350935 10072 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59b371cadbb84bfe8ffe20fb018ad0d4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45223 } }
I20260929 06:33:44.350962 10067 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:33:44.351275 10073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59b371cadbb84bfe8ffe20fb018ad0d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59b371cadbb84bfe8ffe20fb018ad0d4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45223 } } }
I20260929 06:33:44.351357 10073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [sys.catalog]: This master's current role is: LEADER
I20260929 06:33:44.351598 10076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:33:44.352144 10076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:33:44.352656 10074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59b371cadbb84bfe8ffe20fb018ad0d4. Latest consensus state: current_term: 1 leader_uuid: "59b371cadbb84bfe8ffe20fb018ad0d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59b371cadbb84bfe8ffe20fb018ad0d4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45223 } } }
I20260929 06:33:44.352726 10074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4 [sys.catalog]: This master's current role is: LEADER
I20260929 06:33:44.354557 10076 catalog_manager.cc:1347] Generated new cluster ID: 6e17e9b9719e497197d14b80beccd1d2
I20260929 06:33:44.354609 10076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:33:44 dist-test-slave-601b krb5kdc[9986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:44.359827 10071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.348566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56308 (local address 127.9.61.126:45223)
0929 06:33:44.348738 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:44.348753 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:44.348781 (+ 28us) server_negotiation.cc:407] Connection header received
0929 06:33:44.348934 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:44.348939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:44.348982 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:44.349090 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:44.349877 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.350965 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.352134 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.352724 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.353154 (+ 430us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.355526 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:44.355543 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:44.355543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:44.355555 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:44.357598 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:44.357994 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:44.357997 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:44.357998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:44.358126 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:44.358332 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:44.358333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:44.358334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:44.358646 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:44.359367 (+ 721us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:44.359444 (+ 77us) server_negotiation.cc:299] Negotiation successful
0929 06:33:44.359597 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
I20260929 06:33:44.378228 10076 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:33:44.378793 10076 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:33:44.384385 10076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59b371cadbb84bfe8ffe20fb018ad0d4: Generated new TSK 0
I20260929 06:33:44.384605 10076 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:33:44.420782 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45223
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:44.501474 10093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:44.501674 10093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:44.501700 10093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:44.502789 10093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:44.502823 10093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:44.502849 10093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:33:44.504377 10093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45223
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:44.504573 10093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:44.504762 10093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:44.509778 10101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:44.509949 10093 server_base.cc:1034] running on GCE node
W20260929 06:33:44.509836 10098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:44.509775 10099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:44.510234 10093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:44.510430 10093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:44.511569 10093 hybrid_clock.cc:648] HybridClock initialized: now 1790663624511552 us; error 40 us; skew 500 ppm
Sep 29 06:33:44 dist-test-slave-601b krb5kdc[9986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663624, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:44.513971 10093 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:33:44.514495 10093 webserver.cc:460] Webserver started at http://127.9.61.65:38673/ using document root <none> and password file <none>
I20260929 06:33:44.514768 10093 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:44.514837 10093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:44.514981 10093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:44.516199 10093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "0000d744fd374b3ca8a90aa4b20a9575"
format_stamp: "Formatted at 2026-09-29 06:33:44 on dist-test-slave-601b"
server_key: "1de71909a3c6e00713c7dd72f49d5ac7"
server_key_iv: "261a83d6ba34d23a0192a0dcfd5d6a0e"
server_key_version: "encryptionkey@0"
I20260929 06:33:44.516491 10093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "0000d744fd374b3ca8a90aa4b20a9575"
format_stamp: "Formatted at 2026-09-29 06:33:44 on dist-test-slave-601b"
server_key: "1de71909a3c6e00713c7dd72f49d5ac7"
server_key_iv: "261a83d6ba34d23a0192a0dcfd5d6a0e"
server_key_version: "encryptionkey@0"
I20260929 06:33:44.517714 10093 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:44.518404 10108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:44.518627 10093 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:44.518710 10093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "0000d744fd374b3ca8a90aa4b20a9575"
format_stamp: "Formatted at 2026-09-29 06:33:44 on dist-test-slave-601b"
server_key: "1de71909a3c6e00713c7dd72f49d5ac7"
server_key_iv: "261a83d6ba34d23a0192a0dcfd5d6a0e"
server_key_version: "encryptionkey@0"
I20260929 06:33:44.518770 10093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:44.539309 10093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:44.541199 10093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:44.541314 10093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:44.541508 10093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:44.541857 10093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:44.541890 10093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:44.541940 10093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:44.541965 10093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:44.547900 10221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:43259 every 8 connection(s)
I20260929 06:33:44.547879 10093 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:43259
I20260929 06:33:44.549198 10093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:33:44.555639 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 10093
I20260929 06:33:44.555724 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
Sep 29 06:33:44 dist-test-slave-601b krb5kdc[9986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663624, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:44.555941 9461 external_mini_cluster.cc:1428] Setting key 37cd332389ecca2d39edf758deb770ed
I20260929 06:33:44.559592 10071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.549982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:34931 (local address 127.9.61.126:45223)
0929 06:33:44.550049 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:44.550052 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:44.550314 (+ 262us) server_negotiation.cc:407] Connection header received
0929 06:33:44.551338 (+ 1024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:44.551340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:44.551353 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:44.551405 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:44.552068 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.552727 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.553729 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.553954 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.554039 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.556428 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:44.556430 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:44.556430 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:44.556439 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:44.558050 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:44.558533 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:44.558534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:44.558535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:44.558620 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:44.558882 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:44.558883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:44.558883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:44.559005 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:44.559102 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:44.559388 (+ 286us) server_negotiation.cc:299] Negotiation successful
0929 06:33:44.559488 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 06:33:44.559756 10224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.549974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45223 (local address 127.9.61.65:34931)
0929 06:33:44.550177 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:44.550214 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:44.551213 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:44.551485 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:44.551489 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:44.551755 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:44.551967 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.551972 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.552824 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.552826 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.553635 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.553637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.554052 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.554053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.554191 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.554778 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:44.554786 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:44.556337 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:44.558150 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:44.558157 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:44.558160 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:44.558421 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:44.558687 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:44.558687 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:44.558688 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:44.558814 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:44.559092 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:44.559099 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:44.559248 (+ 149us) client_negotiation.cc:769] Sending connection context
0929 06:33:44.559352 (+ 104us) client_negotiation.cc:240] Negotiation successful
0929 06:33:44.559515 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":99,"threads_started":1}
I20260929 06:33:44.560312 10222 heartbeater.cc:347] Connected to a master server at 127.9.61.126:45223
I20260929 06:33:44.560413 10222 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:44.560626 10222 heartbeater.cc:511] Master 127.9.61.126:45223 requested a full tablet report, sending...
I20260929 06:33:44.561240 10031 ts_manager.cc:194] Registered new tserver with Master: 0000d744fd374b3ca8a90aa4b20a9575 (127.9.61.65:43259)
I20260929 06:33:44.562215 10031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:34931
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:33:44.582052 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45223
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:44.664439 10227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:44.664659 10227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:44.664682 10227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:44.665799 10227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:44.665834 10227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:44.665860 10227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:33:44.667354 10227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45223
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:44.667558 10227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:44.667728 10227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:33:44.672788 10227 server_base.cc:1034] running on GCE node
W20260929 06:33:44.672705 10235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:44.672690 10233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:44.672688 10232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:44.673163 10227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:44.673417 10227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:44.674600 10227 hybrid_clock.cc:648] HybridClock initialized: now 1790663624674570 us; error 59 us; skew 500 ppm
Sep 29 06:33:44 dist-test-slave-601b krb5kdc[9986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663624, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:44.677415 10227 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:33:44.677917 10227 webserver.cc:460] Webserver started at http://127.9.61.66:38561/ using document root <none> and password file <none>
I20260929 06:33:44.678162 10227 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:44.678236 10227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:44.678388 10227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:44.679461 10227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "5d3afe88e4964fc59bcf9ca98db33ef9"
format_stamp: "Formatted at 2026-09-29 06:33:44 on dist-test-slave-601b"
server_key: "f114dc121a0fcaf20ee41caaf95b7036"
server_key_iv: "237f7251224f1a4f11a92407206332da"
server_key_version: "encryptionkey@0"
I20260929 06:33:44.679836 10227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "5d3afe88e4964fc59bcf9ca98db33ef9"
format_stamp: "Formatted at 2026-09-29 06:33:44 on dist-test-slave-601b"
server_key: "f114dc121a0fcaf20ee41caaf95b7036"
server_key_iv: "237f7251224f1a4f11a92407206332da"
server_key_version: "encryptionkey@0"
I20260929 06:33:44.681238 10227 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:33:44.681982 10242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:44.682181 10227 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:33:44.682287 10227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "5d3afe88e4964fc59bcf9ca98db33ef9"
format_stamp: "Formatted at 2026-09-29 06:33:44 on dist-test-slave-601b"
server_key: "f114dc121a0fcaf20ee41caaf95b7036"
server_key_iv: "237f7251224f1a4f11a92407206332da"
server_key_version: "encryptionkey@0"
I20260929 06:33:44.682361 10227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:44.697719 10227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:44.700191 10227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:44.700352 10227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:44.700598 10227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:44.700917 10227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:44.700973 10227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:44.701025 10227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:44.701056 10227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:44.707227 10227 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:43487
I20260929 06:33:44.707269 10355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:43487 every 8 connection(s)
I20260929 06:33:44.707599 10227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:33:44 dist-test-slave-601b krb5kdc[9986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663624, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:44.717217 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 10227
I20260929 06:33:44.717270 10071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.708379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:42035 (local address 127.9.61.126:45223)
0929 06:33:44.708425 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:44.708427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:44.708691 (+ 264us) server_negotiation.cc:407] Connection header received
0929 06:33:44.709701 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:44.709703 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:44.709717 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:44.709768 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:44.710415 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.710918 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.711987 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.712191 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.712283 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.714502 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:44.714504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:44.714504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:44.714513 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:44.715875 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:44.716334 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:44.716335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:44.716335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:44.716389 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:44.716618 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:44.716618 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:44.716618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:44.716722 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:44.716775 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:44.717079 (+ 304us) server_negotiation.cc:299] Negotiation successful
0929 06:33:44.717164 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:33:44.717320 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:33:44.717398 10358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.708381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45223 (local address 127.9.61.66:42035)
0929 06:33:44.708566 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:44.708601 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:44.709572 (+ 971us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:44.709840 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:44.709844 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:44.710121 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:44.710313 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.710318 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.711023 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.711024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.711845 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.711848 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.712291 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.712292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.712419 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.712918 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:44.712926 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:44.714380 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:44.715996 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:44.716004 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:44.716006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:44.716265 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:44.716450 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:44.716451 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:44.716451 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:44.716549 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:44.716808 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:44.716814 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:44.716938 (+ 124us) client_negotiation.cc:769] Sending connection context
0929 06:33:44.717036 (+ 98us) client_negotiation.cc:240] Negotiation successful
0929 06:33:44.717162 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
I20260929 06:33:44.717525 9461 external_mini_cluster.cc:1428] Setting key db3ef6383025e0d824ce3680d3715a1c
I20260929 06:33:44.717914 10356 heartbeater.cc:347] Connected to a master server at 127.9.61.126:45223
I20260929 06:33:44.718053 10356 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:44.718262 10356 heartbeater.cc:511] Master 127.9.61.126:45223 requested a full tablet report, sending...
I20260929 06:33:44.718647 10031 ts_manager.cc:194] Registered new tserver with Master: 5d3afe88e4964fc59bcf9ca98db33ef9 (127.9.61.66:43487)
I20260929 06:33:44.719020 10031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:42035
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:33:44.742235 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45223
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:44.825114 10361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:44.825309 10361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:44.825331 10361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:44.826478 10361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:44.826514 10361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:44.826540 10361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:33:44.828032 10361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45223
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:44.828299 10361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:44.828527 10361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:44.833488 10367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:44.833443 10369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:44.833443 10366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:44.833704 10361 server_base.cc:1034] running on GCE node
I20260929 06:33:44.833971 10361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:44.834226 10361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:44.835386 10361 hybrid_clock.cc:648] HybridClock initialized: now 1790663624835373 us; error 26 us; skew 500 ppm
Sep 29 06:33:44 dist-test-slave-601b krb5kdc[9986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663624, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:44.837960 10361 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:33:44.838379 10361 webserver.cc:460] Webserver started at http://127.9.61.67:37553/ using document root <none> and password file <none>
I20260929 06:33:44.838594 10361 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:44.838644 10361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:44.838732 10361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:44.839713 10361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "3d2fad62f3e4466cb6b367175f1c1a5b"
format_stamp: "Formatted at 2026-09-29 06:33:44 on dist-test-slave-601b"
server_key: "7289d3e79ab4a23d376e5915b63b46cb"
server_key_iv: "d9348920a22e336bcb0cbae6318e6c07"
server_key_version: "encryptionkey@0"
I20260929 06:33:44.840093 10361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "3d2fad62f3e4466cb6b367175f1c1a5b"
format_stamp: "Formatted at 2026-09-29 06:33:44 on dist-test-slave-601b"
server_key: "7289d3e79ab4a23d376e5915b63b46cb"
server_key_iv: "d9348920a22e336bcb0cbae6318e6c07"
server_key_version: "encryptionkey@0"
I20260929 06:33:44.841377 10361 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:33:44.842095 10376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:44.842267 10361 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:33:44.842347 10361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "3d2fad62f3e4466cb6b367175f1c1a5b"
format_stamp: "Formatted at 2026-09-29 06:33:44 on dist-test-slave-601b"
server_key: "7289d3e79ab4a23d376e5915b63b46cb"
server_key_iv: "d9348920a22e336bcb0cbae6318e6c07"
server_key_version: "encryptionkey@0"
I20260929 06:33:44.842397 10361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:44.865713 10361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:44.867704 10361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:44.867816 10361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:44.868103 10361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:44.868389 10361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:44.868420 10361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:44.868443 10361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:44.868455 10361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:44.874038 10361 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:41063
I20260929 06:33:44.874089 10489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:41063 every 8 connection(s)
I20260929 06:33:44.874428 10361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:33:44.877170 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 10361
I20260929 06:33:44.877271 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:33:44.877417 9461 external_mini_cluster.cc:1428] Setting key 58a3f9cdb09e88171d44733f9c116ce1
Sep 29 06:33:44 dist-test-slave-601b krb5kdc[9986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663624, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:44.884203 10071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.875143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:55055 (local address 127.9.61.126:45223)
0929 06:33:44.875206 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:44.875209 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:44.875378 (+ 169us) server_negotiation.cc:407] Connection header received
0929 06:33:44.876366 (+ 988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:44.876367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:44.876377 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:44.876438 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:44.877048 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.877837 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.878992 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.879189 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.879250 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.881334 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:44.881336 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:44.881336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:44.881343 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:44.882828 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:44.883227 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:44.883229 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:44.883229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:44.883293 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:44.883526 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:44.883526 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:44.883527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:44.883643 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:44.883700 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:44.883930 (+ 230us) server_negotiation.cc:299] Negotiation successful
0929 06:33:44.884122 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:33:44.884367 10492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.875097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45223 (local address 127.9.61.67:55055)
0929 06:33:44.875255 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:44.875295 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:44.876271 (+ 976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:44.876510 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:44.876514 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:44.876762 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:44.876951 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.876974 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.877921 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.877924 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.878915 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.878917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.879265 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.879265 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.879361 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.879807 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:44.879815 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:44.881223 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:44.882906 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:44.882911 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:44.882913 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:44.883123 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:44.883365 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:44.883366 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:44.883366 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:44.883464 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:44.883702 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:44.883706 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:44.883818 (+ 112us) client_negotiation.cc:769] Sending connection context
0929 06:33:44.883898 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 06:33:44.884125 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":94,"threads_started":1}
I20260929 06:33:44.884878 10490 heartbeater.cc:347] Connected to a master server at 127.9.61.126:45223
I20260929 06:33:44.885002 10490 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:44.885211 10490 heartbeater.cc:511] Master 127.9.61.126:45223 requested a full tablet report, sending...
I20260929 06:33:44.885577 10031 ts_manager.cc:194] Registered new tserver with Master: 3d2fad62f3e4466cb6b367175f1c1a5b (127.9.61.67:41063)
I20260929 06:33:44.885987 10031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:55055
I20260929 06:33:44.889003 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:33:44.897174 10071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.890595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56316 (local address 127.9.61.126:45223)
0929 06:33:44.890666 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:44.890669 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:44.890772 (+ 103us) server_negotiation.cc:407] Connection header received
0929 06:33:44.890856 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:44.890857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:44.890868 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:44.890929 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:44.891545 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.892156 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.892953 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.893171 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.893263 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.894517 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:44.894518 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:44.894519 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:44.894527 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:44.895827 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:44.896264 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:44.896266 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:44.896267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:44.896336 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:44.896558 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:44.896559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:44.896559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:44.896725 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:44.896842 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:44.896970 (+ 128us) server_negotiation.cc:299] Negotiation successful
0929 06:33:44.897051 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260929 06:33:44.899338 10031 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:33:44.901019 10031 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:33:44.907763 10504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.903400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45070 (local address 127.9.61.67:41063)
0929 06:33:44.903828 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:44.903833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:44.903843 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:33:44.903883 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:44.903885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:44.903901 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:44.904271 (+ 370us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:44.904361 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.905118 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.906718 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.907303 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.907412 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.907481 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:44.907619 (+ 138us) server_negotiation.cc:299] Negotiation successful
0929 06:33:44.907663 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":97,"threads_started":1}
I20260929 06:33:44.907789 10503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.903308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:41063 (local address 127.0.0.1:45070)
0929 06:33:44.903485 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:44.903537 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:44.903605 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:44.904081 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:44.904082 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:44.904085 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:44.904178 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.904181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.905236 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.905237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.906613 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.906616 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.907414 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.907415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.907501 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.907515 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 06:33:44.907603 (+ 88us) client_negotiation.cc:240] Negotiation successful
0929 06:33:44.907665 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":49,"threads_started":1}
I20260929 06:33:44.908000 10506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.903617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35682 (local address 127.9.61.65:43259)
0929 06:33:44.903860 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:44.903863 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:44.904055 (+ 192us) server_negotiation.cc:407] Connection header received
0929 06:33:44.904095 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:44.904097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:44.904114 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:44.904185 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:44.904385 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.905469 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.906694 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.907391 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.907464 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.907518 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:44.907828 (+ 310us) server_negotiation.cc:299] Negotiation successful
0929 06:33:44.907878 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":93,"threads_started":1}
I20260929 06:33:44.908042 10502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.903346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43259 (local address 127.0.0.1:35682)
0929 06:33:44.903892 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:44.903899 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:44.903983 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:44.904274 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:44.904274 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:44.904276 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:44.904312 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.904314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.905615 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.905617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.906605 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.906608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.907555 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.907556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.907622 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.907627 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:33:44.907673 (+ 46us) client_negotiation.cc:240] Negotiation successful
0929 06:33:44.907720 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":64,"threads_started":1}
I20260929 06:33:44.908530 10501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.903315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43487 (local address 127.0.0.1:36984)
0929 06:33:44.903704 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:44.903713 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:44.903750 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:44.904028 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:44.904032 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:44.904034 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:44.904171 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.904174 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.905590 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.905591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.906782 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.906784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.907719 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.907720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.907772 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.907775 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:33:44.908410 (+ 635us) client_negotiation.cc:240] Negotiation successful
0929 06:33:44.908456 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"mutex_wait_us":26,"thread_start_us":95,"threads_started":1}
I20260929 06:33:44.908564 10424 tablet_service.cc:1467] Processing CreateTablet for tablet 54227a2af2c4438794ca80d5bf8eaa40 (DEFAULT_TABLE table=test-table [id=bc77734512b34e2b9523a2e0f12a847f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:44.908809 10505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.903570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36984 (local address 127.9.61.66:43487)
0929 06:33:44.903755 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:44.903760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:44.903774 (+ 14us) server_negotiation.cc:407] Connection header received
0929 06:33:44.903821 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:44.903824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:44.903844 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:44.903987 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:44.904259 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.905465 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.906867 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.907575 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.907637 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.907689 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:44.908688 (+ 999us) server_negotiation.cc:299] Negotiation successful
0929 06:33:44.908739 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":89,"threads_started":1}
I20260929 06:33:44.908727 10156 tablet_service.cc:1467] Processing CreateTablet for tablet 54227a2af2c4438794ca80d5bf8eaa40 (DEFAULT_TABLE table=test-table [id=bc77734512b34e2b9523a2e0f12a847f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:44.908980 10424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54227a2af2c4438794ca80d5bf8eaa40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:44.909071 10156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54227a2af2c4438794ca80d5bf8eaa40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:44.909461 10290 tablet_service.cc:1467] Processing CreateTablet for tablet 54227a2af2c4438794ca80d5bf8eaa40 (DEFAULT_TABLE table=test-table [id=bc77734512b34e2b9523a2e0f12a847f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:44.909777 10290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54227a2af2c4438794ca80d5bf8eaa40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:44.911550 10507 tablet_bootstrap.cc:492] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575: Bootstrap starting.
I20260929 06:33:44.912290 10507 tablet_bootstrap.cc:654] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:44.912631 10508 tablet_bootstrap.cc:492] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b: Bootstrap starting.
I20260929 06:33:44.912833 10507 log.cc:824] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:44.913187 10509 tablet_bootstrap.cc:492] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9: Bootstrap starting.
I20260929 06:33:44.913267 10508 tablet_bootstrap.cc:654] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:44.913798 10508 log.cc:824] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:44.913826 10509 tablet_bootstrap.cc:654] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:44.914085 10507 tablet_bootstrap.cc:492] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575: No bootstrap required, opened a new log
I20260929 06:33:44.914180 10507 ts_tablet_manager.cc:1397] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260929 06:33:44.914469 10509 log.cc:824] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:44.914561 10508 tablet_bootstrap.cc:492] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b: No bootstrap required, opened a new log
I20260929 06:33:44.914660 10508 ts_tablet_manager.cc:1397] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:33:44.915282 10509 tablet_bootstrap.cc:492] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9: No bootstrap required, opened a new log
I20260929 06:33:44.915349 10509 ts_tablet_manager.cc:1397] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:33:44.916525 10508 raft_consensus.cc:348] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41063 } } peers { permanent_uuid: "5d3afe88e4964fc59bcf9ca98db33ef9" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43487 } } peers { permanent_uuid: "0000d744fd374b3ca8a90aa4b20a9575" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43259 } }
I20260929 06:33:44.916690 10508 raft_consensus.cc:374] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:44.916733 10508 raft_consensus.cc:729] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d2fad62f3e4466cb6b367175f1c1a5b, State: Initialized, Role: FOLLOWER
I20260929 06:33:44.916651 10507 raft_consensus.cc:348] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41063 } } peers { permanent_uuid: "5d3afe88e4964fc59bcf9ca98db33ef9" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43487 } } peers { permanent_uuid: "0000d744fd374b3ca8a90aa4b20a9575" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43259 } }
I20260929 06:33:44.916841 10507 raft_consensus.cc:374] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:44.916888 10507 raft_consensus.cc:729] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0000d744fd374b3ca8a90aa4b20a9575, State: Initialized, Role: FOLLOWER
I20260929 06:33:44.916870 10508 consensus_queue.cc:260] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41063 } } peers { permanent_uuid: "5d3afe88e4964fc59bcf9ca98db33ef9" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43487 } } peers { permanent_uuid: "0000d744fd374b3ca8a90aa4b20a9575" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43259 } }
I20260929 06:33:44.917034 10507 consensus_queue.cc:260] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41063 } } peers { permanent_uuid: "5d3afe88e4964fc59bcf9ca98db33ef9" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43487 } } peers { permanent_uuid: "0000d744fd374b3ca8a90aa4b20a9575" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43259 } }
I20260929 06:33:44.917165 10508 ts_tablet_manager.cc:1428] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:33:44.917227 10490 heartbeater.cc:503] Master 127.9.61.126:45223 was elected leader, sending a full tablet report...
I20260929 06:33:44.917323 10507 ts_tablet_manager.cc:1428] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:33:44.917469 10222 heartbeater.cc:503] Master 127.9.61.126:45223 was elected leader, sending a full tablet report...
I20260929 06:33:44.917644 10509 raft_consensus.cc:348] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41063 } } peers { permanent_uuid: "5d3afe88e4964fc59bcf9ca98db33ef9" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43487 } } peers { permanent_uuid: "0000d744fd374b3ca8a90aa4b20a9575" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43259 } }
I20260929 06:33:44.917826 10509 raft_consensus.cc:374] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:44.917868 10509 raft_consensus.cc:729] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d3afe88e4964fc59bcf9ca98db33ef9, State: Initialized, Role: FOLLOWER
I20260929 06:33:44.917994 10509 consensus_queue.cc:260] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41063 } } peers { permanent_uuid: "5d3afe88e4964fc59bcf9ca98db33ef9" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43487 } } peers { permanent_uuid: "0000d744fd374b3ca8a90aa4b20a9575" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43259 } }
I20260929 06:33:44.918306 10509 ts_tablet_manager.cc:1428] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:33:44.918457 10356 heartbeater.cc:503] Master 127.9.61.126:45223 was elected leader, sending a full tablet report...
I20260929 06:33:44.952371 10513 raft_consensus.cc:482] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:33:44.952494 10513 raft_consensus.cc:504] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41063 } } peers { permanent_uuid: "5d3afe88e4964fc59bcf9ca98db33ef9" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43487 } } peers { permanent_uuid: "0000d744fd374b3ca8a90aa4b20a9575" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43259 } }
I20260929 06:33:44.952831 10513 leader_election.cc:288] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d3afe88e4964fc59bcf9ca98db33ef9 (127.9.61.66:43487), 0000d744fd374b3ca8a90aa4b20a9575 (127.9.61.65:43259)
I20260929 06:33:44.956823 10505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.953055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:33027 (local address 127.9.61.66:43487)
0929 06:33:44.953143 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:44.953145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:44.953156 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:33:44.953185 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:44.953185 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:44.953198 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:44.953261 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:44.953469 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.954240 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.955837 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.956438 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.956514 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.956525 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:44.956713 (+ 188us) server_negotiation.cc:299] Negotiation successful
0929 06:33:44.956752 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260929 06:33:44.956823 10506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.953108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:36523 (local address 127.9.61.65:43259)
0929 06:33:44.953169 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:44.953171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:44.953321 (+ 150us) server_negotiation.cc:407] Connection header received
0929 06:33:44.953353 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:44.953354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:44.953364 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:44.953401 (+ 37us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:44.953563 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.954278 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.955837 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.956436 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.956514 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.956525 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:44.956713 (+ 188us) server_negotiation.cc:299] Negotiation successful
0929 06:33:44.956752 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:33:44.956862 10492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.952984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43487 (local address 127.9.61.67:33027)
0929 06:33:44.953033 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:44.953046 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:44.953101 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:44.953292 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:44.953293 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:44.953295 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:44.953373 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.953374 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.954344 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.954345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.955730 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.955734 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.956542 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.956543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.956639 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.956642 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:33:44.956693 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 06:33:44.956741 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":93}
I20260929 06:33:44.956876 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.953005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43259 (local address 127.9.61.67:36523)
0929 06:33:44.953210 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:44.953217 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:44.953286 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:44.953428 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:44.953428 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:44.953430 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:44.953492 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.953493 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.954351 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.954351 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.955753 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:44.955755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.956542 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.956543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:44.956627 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.956631 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:33:44.956693 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 06:33:44.956741 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":98,"thread_start_us":121,"threads_started":1}
I20260929 06:33:44.957314 10310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54227a2af2c4438794ca80d5bf8eaa40" candidate_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d3afe88e4964fc59bcf9ca98db33ef9" is_pre_election: true
I20260929 06:33:44.957378 10176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54227a2af2c4438794ca80d5bf8eaa40" candidate_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0000d744fd374b3ca8a90aa4b20a9575" is_pre_election: true
I20260929 06:33:44.957468 10310 raft_consensus.cc:2454] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d2fad62f3e4466cb6b367175f1c1a5b in term 0.
I20260929 06:33:44.957548 10176 raft_consensus.cc:2454] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d2fad62f3e4466cb6b367175f1c1a5b in term 0.
I20260929 06:33:44.957755 10379 leader_election.cc:302] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d2fad62f3e4466cb6b367175f1c1a5b, 5d3afe88e4964fc59bcf9ca98db33ef9; no voters:
I20260929 06:33:44.957883 10513 raft_consensus.cc:2781] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:33:44.957938 10513 raft_consensus.cc:482] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:33:44.957966 10513 raft_consensus.cc:3037] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [term 0 FOLLOWER]: Advancing to term 1
W20260929 06:33:44.958171 10357 tablet.cc:2369] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:33:44.958685 10513 raft_consensus.cc:504] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41063 } } peers { permanent_uuid: "5d3afe88e4964fc59bcf9ca98db33ef9" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43487 } } peers { permanent_uuid: "0000d744fd374b3ca8a90aa4b20a9575" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43259 } }
I20260929 06:33:44.958834 10513 leader_election.cc:288] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [CANDIDATE]: Term 1 election: Requested vote from peers 5d3afe88e4964fc59bcf9ca98db33ef9 (127.9.61.66:43487), 0000d744fd374b3ca8a90aa4b20a9575 (127.9.61.65:43259)
I20260929 06:33:44.958972 10310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54227a2af2c4438794ca80d5bf8eaa40" candidate_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d3afe88e4964fc59bcf9ca98db33ef9"
I20260929 06:33:44.958987 10176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54227a2af2c4438794ca80d5bf8eaa40" candidate_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0000d744fd374b3ca8a90aa4b20a9575"
I20260929 06:33:44.959074 10176 raft_consensus.cc:3037] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:44.959076 10310 raft_consensus.cc:3037] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:44.959740 10176 raft_consensus.cc:2454] T 54227a2af2c4438794ca80d5bf8eaa40 P 0000d744fd374b3ca8a90aa4b20a9575 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d2fad62f3e4466cb6b367175f1c1a5b in term 1.
I20260929 06:33:44.959811 10310 raft_consensus.cc:2454] T 54227a2af2c4438794ca80d5bf8eaa40 P 5d3afe88e4964fc59bcf9ca98db33ef9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d2fad62f3e4466cb6b367175f1c1a5b in term 1.
I20260929 06:33:44.959913 10380 leader_election.cc:302] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0000d744fd374b3ca8a90aa4b20a9575, 3d2fad62f3e4466cb6b367175f1c1a5b; no voters:
I20260929 06:33:44.960016 10513 raft_consensus.cc:2781] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:44.960165 10513 raft_consensus.cc:686] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [term 1 LEADER]: Becoming Leader. State: Replica: 3d2fad62f3e4466cb6b367175f1c1a5b, State: Running, Role: LEADER
I20260929 06:33:44.960268 10513 consensus_queue.cc:237] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41063 } } peers { permanent_uuid: "5d3afe88e4964fc59bcf9ca98db33ef9" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43487 } } peers { permanent_uuid: "0000d744fd374b3ca8a90aa4b20a9575" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43259 } }
I20260929 06:33:44.961079 10031 catalog_manager.cc:5495] T 54227a2af2c4438794ca80d5bf8eaa40 P 3d2fad62f3e4466cb6b367175f1c1a5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d2fad62f3e4466cb6b367175f1c1a5b (127.9.61.67). New cstate: current_term: 1 leader_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2fad62f3e4466cb6b367175f1c1a5b" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d3afe88e4964fc59bcf9ca98db33ef9" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0000d744fd374b3ca8a90aa4b20a9575" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43259 } health_report { overall_health: UNKNOWN } } }
Sep 29 06:33:44 dist-test-slave-601b krb5kdc[9986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.65@KRBTEST.COM
I20260929 06:33:44.984786 10506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:44.977743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35690 (local address 127.9.61.65:43259)
0929 06:33:44.977817 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:44.977819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:44.977953 (+ 134us) server_negotiation.cc:407] Connection header received
0929 06:33:44.977980 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:44.977981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:44.977990 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:44.978050 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:44.978591 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.979072 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.979753 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:44.979931 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:44.979993 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:44.982249 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:44.982259 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:44.982260 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:44.982266 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:44.983684 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:44.984072 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:44.984075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:44.984075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:44.984130 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:44.984312 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:44.984313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:44.984313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:44.984450 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:44.984550 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:44.984617 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 06:33:44.984677 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Sep 29 06:33:44 dist-test-slave-601b krb5kdc[9986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663624, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 06:33:45 dist-test-slave-601b krb5kdc[9986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663624, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.61.65@KRBTEST.COM
I20260929 06:33:45.007776 10506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:45.000942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35706 (local address 127.9.61.65:43259)
0929 06:33:45.000996 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:45.000998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:45.001103 (+ 105us) server_negotiation.cc:407] Connection header received
0929 06:33:45.001149 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:45.001150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:45.001159 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:45.001217 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:45.001776 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:45.002260 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:45.002961 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:45.003143 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:45.003194 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:45.005489 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:45.005491 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:45.005491 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:45.005498 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:45.006754 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:45.007049 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:45.007050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:45.007051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:45.007101 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:45.007331 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:45.007331 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:45.007331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:45.007416 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:45.007484 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:45.007644 (+ 160us) server_negotiation.cc:299] Negotiation successful
0929 06:33:45.007708 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
Sep 29 06:33:45 dist-test-slave-601b krb5kdc[9986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 06:33:45 dist-test-slave-601b krb5kdc[9986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.65@KRBTEST.COM
I20260929 06:33:45.030838 10506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:45.023235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35708 (local address 127.9.61.65:43259)
0929 06:33:45.023300 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:45.023302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:45.023410 (+ 108us) server_negotiation.cc:407] Connection header received
0929 06:33:45.023487 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:45.023488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:45.023499 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:45.023572 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:45.024229 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:45.024702 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:45.025456 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:45.025648 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:45.025752 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:45.028230 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:45.028232 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:45.028232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:45.028238 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:45.029645 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:45.030197 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:45.030198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:45.030199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:45.030267 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:45.030454 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:45.030455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:45.030455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:45.030550 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:45.030627 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:45.030712 (+ 85us) server_negotiation.cc:299] Negotiation successful
0929 06:33:45.030772 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260929 06:33:45.031347 10136 tablet_service.cc:2908] Rejecting scan request for tablet 54227a2af2c4438794ca80d5bf8eaa40: Uninitialized: clean time has not yet been initialized
I20260929 06:33:45.032351 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 10093
I20260929 06:33:45.036644 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 10227
I20260929 06:33:45.041188 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 10361
I20260929 06:33:45.045405 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 9999
2026-09-29T06:33:45Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (1976 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:33:45 dist-test-slave-601b krb5kdc[10531](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:33:45 dist-test-slave-601b krb5kdc[10531](info): set up 2 sockets
Sep 29 06:33:45 dist-test-slave-601b krb5kdc[10531](info): commencing operation
krb5kdc: starting...
W20260929 06:33:46.143607 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:33:46 dist-test-slave-601b krb5kdc[10531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:33:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:33:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:33:46.258783 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41695
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:44957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:41695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:46.338212 10544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:46.338418 10544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:46.338441 10544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:46.339610 10544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:33:46.339653 10544 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260929 06:33:46.339665 10544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:46.339677 10544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:46.339730 10544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:33:46.339748 10544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:33:46.341200 10544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:44957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:41695
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:46.341457 10544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:46.341712 10544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:46.346479 10549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:46.346482 10550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:46.346510 10552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:46.346661 10544 server_base.cc:1034] running on GCE node
I20260929 06:33:46.346982 10544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:46.347291 10544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:46.348466 10544 hybrid_clock.cc:648] HybridClock initialized: now 1790663626348452 us; error 50 us; skew 500 ppm
Sep 29 06:33:46 dist-test-slave-601b krb5kdc[10531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:46.354475 10544 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:33:46.354936 10544 webserver.cc:460] Webserver started at http://127.9.61.126:45139/ using document root <none> and password file <none>
I20260929 06:33:46.355180 10544 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:46.355250 10544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:46.355407 10544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:46.356612 10544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "20748f49925f462b880be339d609c8d5"
format_stamp: "Formatted at 2026-09-29 06:33:46 on dist-test-slave-601b"
server_key: "7ef47e1ed4ab72fc8706a3a5eb23c818"
server_key_iv: "1a17f8521b64898b12f9508478c037f8"
server_key_version: "encryptionkey@0"
I20260929 06:33:46.356994 10544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "20748f49925f462b880be339d609c8d5"
format_stamp: "Formatted at 2026-09-29 06:33:46 on dist-test-slave-601b"
server_key: "7ef47e1ed4ab72fc8706a3a5eb23c818"
server_key_iv: "1a17f8521b64898b12f9508478c037f8"
server_key_version: "encryptionkey@0"
I20260929 06:33:46.358364 10544 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:33:46.359157 10559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:46.359354 10544 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:46.359465 10544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "20748f49925f462b880be339d609c8d5"
format_stamp: "Formatted at 2026-09-29 06:33:46 on dist-test-slave-601b"
server_key: "7ef47e1ed4ab72fc8706a3a5eb23c818"
server_key_iv: "1a17f8521b64898b12f9508478c037f8"
server_key_version: "encryptionkey@0"
I20260929 06:33:46.359540 10544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:46.387684 10544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:46.389681 10544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:46.389859 10544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:46.394565 10544 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:41695
I20260929 06:33:46.394629 10621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:41695 every 8 connection(s)
I20260929 06:33:46.394951 10544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:33:46.395625 10622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:46.398049 10622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5: Bootstrap starting.
I20260929 06:33:46.398672 10622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:46.398974 10622 log.cc:824] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:46.399664 10622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5: No bootstrap required, opened a new log
I20260929 06:33:46.401800 10622 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20748f49925f462b880be339d609c8d5" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41695 } }
I20260929 06:33:46.401990 10622 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:46.402037 10622 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20748f49925f462b880be339d609c8d5, State: Initialized, Role: FOLLOWER
I20260929 06:33:46.402231 10622 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20748f49925f462b880be339d609c8d5" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41695 } }
I20260929 06:33:46.402336 10622 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:33:46.402376 10622 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:33:46.402429 10622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:46.402980 10622 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20748f49925f462b880be339d609c8d5" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41695 } }
I20260929 06:33:46.403103 10622 leader_election.cc:302] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20748f49925f462b880be339d609c8d5; no voters:
I20260929 06:33:46.403290 10622 leader_election.cc:288] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:33:46.403340 10625 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:46.403553 10625 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [term 1 LEADER]: Becoming Leader. State: Replica: 20748f49925f462b880be339d609c8d5, State: Running, Role: LEADER
I20260929 06:33:46.403558 10622 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:33:46.403847 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 10544
I20260929 06:33:46.403986 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:33:46.404150 9461 external_mini_cluster.cc:1428] Setting key 54de5434fe8158d6ad2c898fc109e232
I20260929 06:33:46.404271 10625 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20748f49925f462b880be339d609c8d5" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41695 } }
I20260929 06:33:46.404990 10626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20748f49925f462b880be339d609c8d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20748f49925f462b880be339d609c8d5" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41695 } } }
I20260929 06:33:46.405108 10627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20748f49925f462b880be339d609c8d5. Latest consensus state: current_term: 1 leader_uuid: "20748f49925f462b880be339d609c8d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20748f49925f462b880be339d609c8d5" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41695 } } }
I20260929 06:33:46.405319 10626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [sys.catalog]: This master's current role is: LEADER
I20260929 06:33:46.405324 10627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5 [sys.catalog]: This master's current role is: LEADER
W20260929 06:33:46.405478 10641 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:33:46.405524 10641 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:33:46.405663 10643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:33:46.405887 10643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:33:46.407462 10643 catalog_manager.cc:1347] Generated new cluster ID: d34b016707cd4377a381e4c34dceeab3
I20260929 06:33:46.407513 10643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:33:46 dist-test-slave-601b krb5kdc[10531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:46.416416 10639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.404737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48332 (local address 127.9.61.126:41695)
0929 06:33:46.404942 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:46.404951 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:46.405283 (+ 332us) server_negotiation.cc:407] Connection header received
0929 06:33:46.405432 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:46.405440 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:46.405505 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:46.405653 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:46.406543 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.407965 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.408999 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.409628 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.409747 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.412601 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:46.412607 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:46.412607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:46.412621 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:46.414631 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.415089 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.415092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.415093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.415215 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.415439 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.415440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.415440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.415739 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:46.415886 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:46.416034 (+ 148us) server_negotiation.cc:299] Negotiation successful
0929 06:33:46.416174 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":92,"threads_started":1}
I20260929 06:33:46.420281 10643 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:33:46.420787 10643 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:33:46.428885 10643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5: Generated new TSK 0
I20260929 06:33:46.429085 10643 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:33:46.452900 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41695
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:44957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:46.534750 10648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:46.534957 10648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:46.534981 10648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:46.536192 10648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:46.536234 10648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:46.536254 10648 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:33:46.536273 10648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:33:46.537829 10648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:44957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.61.126:41695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:46.538086 10648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:46.538321 10648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:46.543323 10654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:46.543342 10653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:46.543344 10656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:46.543646 10648 server_base.cc:1034] running on GCE node
I20260929 06:33:46.543846 10648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:46.544131 10648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:46.545300 10648 hybrid_clock.cc:648] HybridClock initialized: now 1790663626545281 us; error 35 us; skew 500 ppm
Sep 29 06:33:46 dist-test-slave-601b krb5kdc[10531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:46.547886 10648 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:33:46.548331 10648 webserver.cc:460] Webserver started at http://127.9.61.65:38479/ using document root <none> and password file <none>
I20260929 06:33:46.548525 10648 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:46.548566 10648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:46.548656 10648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:46.549649 10648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "b6b586048da3499eb3c7c6441d6ccd8e"
format_stamp: "Formatted at 2026-09-29 06:33:46 on dist-test-slave-601b"
server_key: "66171b0c459f1a7d80d3dd636c08f73e"
server_key_iv: "72b9261426ff725644b840bc848569fb"
server_key_version: "encryptionkey@0"
I20260929 06:33:46.549945 10648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "b6b586048da3499eb3c7c6441d6ccd8e"
format_stamp: "Formatted at 2026-09-29 06:33:46 on dist-test-slave-601b"
server_key: "66171b0c459f1a7d80d3dd636c08f73e"
server_key_iv: "72b9261426ff725644b840bc848569fb"
server_key_version: "encryptionkey@0"
I20260929 06:33:46.551163 10648 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:33:46.551843 10663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:46.552037 10648 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:46.552147 10648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "b6b586048da3499eb3c7c6441d6ccd8e"
format_stamp: "Formatted at 2026-09-29 06:33:46 on dist-test-slave-601b"
server_key: "66171b0c459f1a7d80d3dd636c08f73e"
server_key_iv: "72b9261426ff725644b840bc848569fb"
server_key_version: "encryptionkey@0"
I20260929 06:33:46.552224 10648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:46.582131 10648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:46.584682 10648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:46.584859 10648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:46.585417 10648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:46.585489 10648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:46.585536 10648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:46.585565 10648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:33:46 dist-test-slave-601b krb5kdc[10531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:46.593070 10648 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:35263
I20260929 06:33:46.593146 10778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:35263 every 8 connection(s)
I20260929 06:33:46.593523 10648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:33:46.596442 10639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.585965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:39437 (local address 127.9.61.126:41695)
0929 06:33:46.586018 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:46.586019 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:46.586279 (+ 260us) server_negotiation.cc:407] Connection header received
0929 06:33:46.586840 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:46.586841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:46.586859 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:46.586915 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:46.588089 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.588919 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.590645 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.590878 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.590975 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.593439 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:46.593441 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:46.593442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:46.593451 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:46.594985 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.595429 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.595431 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.595431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.595493 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.595758 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.595759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.595759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.595879 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:46.595975 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:46.596258 (+ 283us) server_negotiation.cc:299] Negotiation successful
0929 06:33:46.596352 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:33:46.596649 10672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.585960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41695 (local address 127.9.61.65:39437)
0929 06:33:46.586147 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:46.586182 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:46.586712 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:46.587067 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:46.587073 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:46.587596 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:46.587966 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.587977 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.589026 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.589027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.590513 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.590517 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.590987 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.590988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.591135 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.591725 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:46.591743 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:46.593341 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:46.595101 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:46.595107 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:46.595109 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:46.595339 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:46.595573 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:46.595574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:46.595574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:46.595686 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:46.595967 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:46.595974 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:46.596121 (+ 147us) client_negotiation.cc:769] Sending connection context
0929 06:33:46.596236 (+ 115us) client_negotiation.cc:240] Negotiation successful
0929 06:33:46.596397 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":104,"threads_started":1}
I20260929 06:33:46.597234 10779 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41695
I20260929 06:33:46.597361 10779 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:46.597563 10779 heartbeater.cc:511] Master 127.9.61.126:41695 requested a full tablet report, sending...
I20260929 06:33:46.597836 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 10648
I20260929 06:33:46.597945 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:33:46.598143 9461 external_mini_cluster.cc:1428] Setting key 4c3d31266fb53057aaf9f7494622dd14
I20260929 06:33:46.598133 10576 ts_manager.cc:194] Registered new tserver with Master: b6b586048da3499eb3c7c6441d6ccd8e (127.9.61.65:35263)
I20260929 06:33:46.599284 10576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:39437
I20260929 06:33:46.605258 10639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.598516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:51233 (local address 127.9.61.126:41695)
0929 06:33:46.598816 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:46.598818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:46.598824 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:33:46.598838 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:46.598838 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:46.598845 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:46.598918 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:46.599300 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.600154 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.600859 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.601171 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.601266 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.602227 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:46.602229 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:46.602229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:46.602236 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:46.603819 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.604348 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.604349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.604349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.604416 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.604685 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.604686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.604686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.604814 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:46.604869 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:46.605090 (+ 221us) server_negotiation.cc:299] Negotiation successful
0929 06:33:46.605176 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283}
I20260929 06:33:46.605315 10785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.598314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41695 (local address 127.9.61.65:51233)
0929 06:33:46.598465 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:46.598476 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:46.598536 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:46.598926 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:46.598927 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:46.599124 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:46.599213 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.599215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.600255 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.600256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.600774 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.600776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.601267 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.601268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.601331 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.601798 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:46.601803 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:46.602136 (+ 333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:46.603900 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:46.603901 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:46.603901 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:46.604225 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:46.604496 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:46.604496 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:46.604497 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:46.604587 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:46.604895 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:46.604896 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:46.604962 (+ 66us) client_negotiation.cc:769] Sending connection context
0929 06:33:46.605047 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 06:33:46.605167 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":95,"threads_started":1}
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:33:46.624454 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41695
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:44957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:46.707156 10788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:46.707360 10788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:46.707383 10788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:46.708576 10788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:46.708622 10788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:46.708643 10788 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:33:46.708662 10788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:33:46.710078 10788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:44957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.61.126:41695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:46.710259 10788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:46.710429 10788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:46.715260 10794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:46.715317 10793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:46.715404 10788 server_base.cc:1034] running on GCE node
W20260929 06:33:46.715317 10796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:46.715715 10788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:46.716005 10788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:46.717183 10788 hybrid_clock.cc:648] HybridClock initialized: now 1790663626717174 us; error 44 us; skew 500 ppm
Sep 29 06:33:46 dist-test-slave-601b krb5kdc[10531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:46.719759 10788 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:33:46.720276 10788 webserver.cc:460] Webserver started at http://127.9.61.66:33045/ using document root <none> and password file <none>
I20260929 06:33:46.720512 10788 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:46.720589 10788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:46.720726 10788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:46.721798 10788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "bb668699d7db4d779489a3034a423cfa"
format_stamp: "Formatted at 2026-09-29 06:33:46 on dist-test-slave-601b"
server_key: "792e58c471b824682c389278b15668d3"
server_key_iv: "b9ea60c39fd32b2f3e3e8d6398575321"
server_key_version: "encryptionkey@0"
I20260929 06:33:46.722183 10788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "bb668699d7db4d779489a3034a423cfa"
format_stamp: "Formatted at 2026-09-29 06:33:46 on dist-test-slave-601b"
server_key: "792e58c471b824682c389278b15668d3"
server_key_iv: "b9ea60c39fd32b2f3e3e8d6398575321"
server_key_version: "encryptionkey@0"
I20260929 06:33:46.723559 10788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:33:46.724457 10803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:46.724649 10788 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:33:46.724776 10788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "bb668699d7db4d779489a3034a423cfa"
format_stamp: "Formatted at 2026-09-29 06:33:46 on dist-test-slave-601b"
server_key: "792e58c471b824682c389278b15668d3"
server_key_iv: "b9ea60c39fd32b2f3e3e8d6398575321"
server_key_version: "encryptionkey@0"
I20260929 06:33:46.724858 10788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:46.739168 10788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:46.741307 10788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:46.741477 10788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:46.742065 10788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:46.742123 10788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:46.742165 10788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:46.742184 10788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:33:46 dist-test-slave-601b krb5kdc[10531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:46.749591 10788 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:42769
I20260929 06:33:46.750020 10788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:33:46.750422 10918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:42769 every 8 connection(s)
I20260929 06:33:46.751924 10639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.742458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:44531 (local address 127.9.61.126:41695)
0929 06:33:46.742539 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:46.742542 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:46.742760 (+ 218us) server_negotiation.cc:407] Connection header received
0929 06:33:46.743323 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:46.743325 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:46.743338 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:46.743388 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:46.744156 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.744677 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.745683 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.745878 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.745961 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.749152 (+ 3191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:46.749154 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:46.749154 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:46.749163 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:46.750840 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.751190 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.751191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.751191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.751239 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.751435 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.751436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.751436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.751532 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:46.751583 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:46.751807 (+ 224us) server_negotiation.cc:299] Negotiation successful
0929 06:33:46.751863 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 06:33:46.752213 10812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.742451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41695 (local address 127.9.61.66:44531)
0929 06:33:46.742621 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:46.742663 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:46.743210 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:46.743467 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:46.743470 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:46.743780 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:46.744054 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.744060 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.744770 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.744771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.745583 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.745585 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.745972 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.745973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.746144 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.746693 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:46.746704 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:46.749058 (+ 2354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:46.750908 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:46.750912 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:46.750914 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:46.751126 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:46.751294 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:46.751295 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:46.751295 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:46.751385 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:46.751586 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:46.751589 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:46.751715 (+ 126us) client_negotiation.cc:769] Sending connection context
0929 06:33:46.751795 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 06:33:46.751906 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":109,"threads_started":1}
I20260929 06:33:46.752707 10919 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41695
I20260929 06:33:46.752801 10919 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:46.752974 10919 heartbeater.cc:511] Master 127.9.61.126:41695 requested a full tablet report, sending...
I20260929 06:33:46.753316 10576 ts_manager.cc:194] Registered new tserver with Master: bb668699d7db4d779489a3034a423cfa (127.9.61.66:42769)
I20260929 06:33:46.753729 10576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:44531
I20260929 06:33:46.758616 10639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.753775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:41261 (local address 127.9.61.126:41695)
0929 06:33:46.753816 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:46.753818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:46.753883 (+ 65us) server_negotiation.cc:407] Connection header received
0929 06:33:46.753949 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:46.753950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:46.753958 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:46.753998 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:46.754325 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.754788 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.755545 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.755718 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.755770 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.756636 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:46.756637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:46.756637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:46.756642 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:46.757711 (+ 1069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.758004 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.758005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.758005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.758066 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.758227 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.758228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.758228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.758357 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:46.758407 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:46.758506 (+ 99us) server_negotiation.cc:299] Negotiation successful
0929 06:33:46.758560 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:33:46.758639 10925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.753689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41695 (local address 127.9.61.66:41261)
0929 06:33:46.753821 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:46.753833 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:46.753894 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:46.754003 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:46.754003 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:46.754195 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:46.754258 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.754259 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.754914 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.754915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.755473 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.755475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.755782 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.755783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.755835 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.756286 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:46.756291 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:46.756569 (+ 278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:46.757778 (+ 1209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:46.757779 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:46.757779 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:46.757932 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:46.758125 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:46.758126 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:46.758126 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:46.758176 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:46.758410 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:46.758410 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:46.758443 (+ 33us) client_negotiation.cc:769] Sending connection context
0929 06:33:46.758492 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 06:33:46.758570 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
I20260929 06:33:46.759575 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 10788
I20260929 06:33:46.759652 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:33:46.759835 9461 external_mini_cluster.cc:1428] Setting key 530472ee5b920e420612b8529b7c42f9
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:33:46.783423 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41695
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:44957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:46.867991 10928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:46.868268 10928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:46.868314 10928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:46.869551 10928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:46.869625 10928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:46.869663 10928 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:33:46.869701 10928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:33:46.871198 10928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:44957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.61.126:41695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:46.871503 10928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:46.871747 10928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:46.876754 10933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:46.876786 10936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:46.876937 10934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:46.877152 10928 server_base.cc:1034] running on GCE node
I20260929 06:33:46.877343 10928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:46.877563 10928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:46.878716 10928 hybrid_clock.cc:648] HybridClock initialized: now 1790663626878687 us; error 43 us; skew 500 ppm
Sep 29 06:33:46 dist-test-slave-601b krb5kdc[10531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:46.881513 10928 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:33:46.882048 10928 webserver.cc:460] Webserver started at http://127.9.61.67:43345/ using document root <none> and password file <none>
I20260929 06:33:46.882293 10928 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:46.882361 10928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:46.882525 10928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:46.883635 10928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "c887beabb5574642b743c0c12b692a88"
format_stamp: "Formatted at 2026-09-29 06:33:46 on dist-test-slave-601b"
server_key: "254cd638a2941ee62de837ae4ffe1775"
server_key_iv: "de479e539cd6aae0a20e349d79e09da4"
server_key_version: "encryptionkey@0"
I20260929 06:33:46.884092 10928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "c887beabb5574642b743c0c12b692a88"
format_stamp: "Formatted at 2026-09-29 06:33:46 on dist-test-slave-601b"
server_key: "254cd638a2941ee62de837ae4ffe1775"
server_key_iv: "de479e539cd6aae0a20e349d79e09da4"
server_key_version: "encryptionkey@0"
I20260929 06:33:46.885500 10928 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:46.886281 10943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:46.886469 10928 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:46.886571 10928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "c887beabb5574642b743c0c12b692a88"
format_stamp: "Formatted at 2026-09-29 06:33:46 on dist-test-slave-601b"
server_key: "254cd638a2941ee62de837ae4ffe1775"
server_key_iv: "de479e539cd6aae0a20e349d79e09da4"
server_key_version: "encryptionkey@0"
I20260929 06:33:46.886660 10928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:46.907044 10928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:46.909682 10928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:46.909857 10928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:46.910475 10928 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:46.910542 10928 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:46.910585 10928 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:46.910606 10928 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:33:46 dist-test-slave-601b krb5kdc[10531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:46.918365 10928 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:37675
I20260929 06:33:46.918576 11058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:37675 every 8 connection(s)
I20260929 06:33:46.918830 10928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:33:46.920853 10639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.910910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:42641 (local address 127.9.61.126:41695)
0929 06:33:46.910983 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:46.910985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:46.911306 (+ 321us) server_negotiation.cc:407] Connection header received
0929 06:33:46.912106 (+ 800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:46.912107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:46.912118 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:46.912177 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:46.913176 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.913726 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.914865 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.915067 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.915156 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.917549 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:46.917551 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:46.917551 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:46.917559 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:46.919449 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.919834 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.919835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.919835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.919891 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.920232 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.920233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.920233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.920357 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:46.920437 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:46.920711 (+ 274us) server_negotiation.cc:299] Negotiation successful
0929 06:33:46.920789 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:33:46.920926 10952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.910901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41695 (local address 127.9.61.67:42641)
0929 06:33:46.911147 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:46.911202 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:46.911982 (+ 780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:46.912274 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:46.912279 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:46.912712 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:46.913062 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.913069 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.913834 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.913835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.914762 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.914765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.915182 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.915183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.915302 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.915882 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:46.915890 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:46.917441 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:46.919533 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:46.919537 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:46.919539 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:46.919763 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:46.920067 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:46.920068 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:46.920068 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:46.920173 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:46.920418 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:46.920421 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:46.920549 (+ 128us) client_negotiation.cc:769] Sending connection context
0929 06:33:46.920627 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 06:33:46.920758 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":131,"threads_started":1}
I20260929 06:33:46.921446 11059 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41695
I20260929 06:33:46.921541 11059 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:46.921741 11059 heartbeater.cc:511] Master 127.9.61.126:41695 requested a full tablet report, sending...
I20260929 06:33:46.922127 10575 ts_manager.cc:194] Registered new tserver with Master: c887beabb5574642b743c0c12b692a88 (127.9.61.67:37675)
I20260929 06:33:46.922623 10575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:42641
I20260929 06:33:46.928613 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 10928
I20260929 06:33:46.928723 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:33:46.928910 9461 external_mini_cluster.cc:1428] Setting key 0f66fc1288be34cc07c21d8465d43d5f
I20260929 06:33:46.929210 10639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.922649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:56651 (local address 127.9.61.126:41695)
0929 06:33:46.922691 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:46.922693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:46.922818 (+ 125us) server_negotiation.cc:407] Connection header received
0929 06:33:46.922881 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:46.922882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:46.922893 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:46.922944 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:46.923356 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.923808 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.924928 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.925260 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.925318 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.926228 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:46.926229 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:46.926230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:46.926236 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:46.927815 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.928205 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.928206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.928206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.928261 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.928565 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.928566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.928566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.928781 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:46.928868 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:46.929059 (+ 191us) server_negotiation.cc:299] Negotiation successful
0929 06:33:46.929147 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:33:46.929579 11065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.922576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41695 (local address 127.9.61.67:56651)
0929 06:33:46.922752 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:46.922763 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:46.922830 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:46.922977 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:46.922978 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:46.923199 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:46.923277 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.923279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.923913 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.923914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.924824 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.924828 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.925350 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.925351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.925430 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.925852 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:46.925856 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:46.926148 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:46.927893 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:46.927894 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:46.927894 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:46.928141 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:46.928343 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:46.928344 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:46.928345 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:46.928443 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:46.928856 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:46.928858 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:46.928912 (+ 54us) client_negotiation.cc:769] Sending connection context
0929 06:33:46.929336 (+ 424us) client_negotiation.cc:240] Negotiation successful
0929 06:33:46.929463 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":91,"threads_started":1}
I20260929 06:33:46.930023 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 06:33:46 dist-test-slave-601b krb5kdc[10531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 06:33:46 dist-test-slave-601b krb5kdc[10531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:46.953265 10639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.945855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48346 (local address 127.9.61.126:41695)
0929 06:33:46.945941 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:46.945944 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:46.945973 (+ 29us) server_negotiation.cc:407] Connection header received
0929 06:33:46.946071 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:46.946073 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:46.946089 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:46.946154 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:46.946743 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.947265 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.948056 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.948268 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.948353 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.950766 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:46.950767 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:46.950768 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:46.950775 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:46.952137 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.952468 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.952468 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.952469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.952522 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:46.952742 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:46.952743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:46.952743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:46.952863 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:46.952940 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:46.953056 (+ 116us) server_negotiation.cc:299] Negotiation successful
0929 06:33:46.953135 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260929 06:33:46.955003 10576 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:33:46.956754 10576 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:33:46.963711 11078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.959256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50350 (local address 127.9.61.66:42769)
0929 06:33:46.959414 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:46.959419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:46.959638 (+ 219us) server_negotiation.cc:407] Connection header received
0929 06:33:46.959770 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:46.959773 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:46.959791 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:46.959851 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:46.960161 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.961317 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.962638 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.963243 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.963339 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.963401 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:46.963547 (+ 146us) server_negotiation.cc:299] Negotiation successful
0929 06:33:46.963593 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260929 06:33:46.963712 11079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.959166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:42769 (local address 127.0.0.1:50350)
0929 06:33:46.959515 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:46.959563 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:46.959669 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:46.959989 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:46.959992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:46.959995 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:46.960069 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.960071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.961423 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.961424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.962546 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.962548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.963342 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.963343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.963434 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.963449 (+ 15us) client_negotiation.cc:769] Sending connection context
0929 06:33:46.963529 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 06:33:46.963613 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"mutex_wait_us":78,"thread_start_us":75,"threads_started":1}
I20260929 06:33:46.963853 11077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.959378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:35263 (local address 127.0.0.1:39350)
0929 06:33:46.959637 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:46.959646 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:46.959690 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:46.960098 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:46.960099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:46.960101 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:46.960139 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.960140 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.961430 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.961431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.962579 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.962580 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.963515 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.963516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.963593 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.963596 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:33:46.963644 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:33:46.963679 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":30,"thread_start_us":81,"threads_started":1}
I20260929 06:33:46.964012 11076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.959166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:37675 (local address 127.0.0.1:53772)
0929 06:33:46.959518 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:46.959563 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:46.959643 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:46.959997 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:46.959998 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:46.960000 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:46.960087 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.960089 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.961034 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.961035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.962311 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:46.962314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.963410 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.963411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:46.963474 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.963479 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:33:46.963528 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 06:33:46.963607 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":3,"thread_start_us":69,"threads_started":1}
I20260929 06:33:46.963934 11081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.959645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39350 (local address 127.9.61.65:35263)
0929 06:33:46.959831 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:46.959835 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:46.959844 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:33:46.959880 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:46.959881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:46.959896 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:46.960044 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:46.960217 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.961339 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.962672 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.963373 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.963435 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.963485 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:46.963753 (+ 268us) server_negotiation.cc:299] Negotiation successful
0929 06:33:46.963794 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":85,"threads_started":1}
I20260929 06:33:46.964640 10853 tablet_service.cc:1467] Processing CreateTablet for tablet c114b2bbd1f04feda2ce275d7fe4cc29 (DEFAULT_TABLE table=test-table [id=a7e42f7a478748b7b11e6f2f8211bef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:46.964910 10713 tablet_service.cc:1467] Processing CreateTablet for tablet c114b2bbd1f04feda2ce275d7fe4cc29 (DEFAULT_TABLE table=test-table [id=a7e42f7a478748b7b11e6f2f8211bef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:46.965060 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c114b2bbd1f04feda2ce275d7fe4cc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:46.965279 10713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c114b2bbd1f04feda2ce275d7fe4cc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:46.968092 11082 tablet_bootstrap.cc:492] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa: Bootstrap starting.
I20260929 06:33:46.968135 11080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:46.959357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53772 (local address 127.9.61.67:37675)
0929 06:33:46.959529 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:46.959533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:46.959737 (+ 204us) server_negotiation.cc:407] Connection header received
0929 06:33:46.959782 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:46.959785 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:46.959824 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:46.959896 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:46.960176 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.960918 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.962429 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:46.963221 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:46.963310 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:46.963373 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:46.963722 (+ 349us) server_negotiation.cc:299] Negotiation successful
0929 06:33:46.963764 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":104,"threads_started":1}
I20260929 06:33:46.968701 11083 tablet_bootstrap.cc:492] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e: Bootstrap starting.
I20260929 06:33:46.968856 10993 tablet_service.cc:1467] Processing CreateTablet for tablet c114b2bbd1f04feda2ce275d7fe4cc29 (DEFAULT_TABLE table=test-table [id=a7e42f7a478748b7b11e6f2f8211bef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:46.968998 11082 tablet_bootstrap.cc:654] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:46.969192 10993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c114b2bbd1f04feda2ce275d7fe4cc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:46.969332 11083 tablet_bootstrap.cc:654] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:46.969337 11082 log.cc:824] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:46.969679 11083 log.cc:824] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:46.970155 11082 tablet_bootstrap.cc:492] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa: No bootstrap required, opened a new log
I20260929 06:33:46.970207 11082 ts_tablet_manager.cc:1397] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:33:46.971819 11082 raft_consensus.cc:348] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } }
I20260929 06:33:46.972019 11082 raft_consensus.cc:374] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:46.972069 11082 raft_consensus.cc:729] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb668699d7db4d779489a3034a423cfa, State: Initialized, Role: FOLLOWER
I20260929 06:33:46.972105 11086 tablet_bootstrap.cc:492] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88: Bootstrap starting.
I20260929 06:33:46.972209 11082 consensus_queue.cc:260] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } }
I20260929 06:33:46.972537 11082 ts_tablet_manager.cc:1428] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260929 06:33:46.972591 10919 heartbeater.cc:503] Master 127.9.61.126:41695 was elected leader, sending a full tablet report...
I20260929 06:33:46.973166 11086 tablet_bootstrap.cc:654] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:46.973196 11083 tablet_bootstrap.cc:492] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e: No bootstrap required, opened a new log
I20260929 06:33:46.973284 11083 ts_tablet_manager.cc:1397] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260929 06:33:46.973495 11086 log.cc:824] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:46.974262 11086 tablet_bootstrap.cc:492] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88: No bootstrap required, opened a new log
I20260929 06:33:46.974351 11086 ts_tablet_manager.cc:1397] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:33:46.975148 11083 raft_consensus.cc:348] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } }
I20260929 06:33:46.975337 11083 raft_consensus.cc:374] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:46.975386 11083 raft_consensus.cc:729] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6b586048da3499eb3c7c6441d6ccd8e, State: Initialized, Role: FOLLOWER
I20260929 06:33:46.975553 11083 consensus_queue.cc:260] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } }
I20260929 06:33:46.975857 11083 ts_tablet_manager.cc:1428] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:33:46.975870 10779 heartbeater.cc:503] Master 127.9.61.126:41695 was elected leader, sending a full tablet report...
I20260929 06:33:46.976229 11086 raft_consensus.cc:348] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } }
I20260929 06:33:46.976413 11086 raft_consensus.cc:374] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:46.976440 11086 raft_consensus.cc:729] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c887beabb5574642b743c0c12b692a88, State: Initialized, Role: FOLLOWER
I20260929 06:33:46.976577 11086 consensus_queue.cc:260] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } }
I20260929 06:33:46.976856 11086 ts_tablet_manager.cc:1428] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:33:46.976882 11059 heartbeater.cc:503] Master 127.9.61.126:41695 was elected leader, sending a full tablet report...
W20260929 06:33:47.000728 10920 tablet.cc:2369] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:33:47.094391 10780 tablet.cc:2369] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:33:47.128702 11087 raft_consensus.cc:482] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:33:47.128831 11087 raft_consensus.cc:504] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } }
I20260929 06:33:47.129289 11087 leader_election.cc:288] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c887beabb5574642b743c0c12b692a88 (127.9.61.67:37675), b6b586048da3499eb3c7c6441d6ccd8e (127.9.61.65:35263)
I20260929 06:33:47.133580 11080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.129781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:60121 (local address 127.9.61.67:37675)
0929 06:33:47.129831 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:47.129833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:47.129842 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:33:47.129879 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:47.129879 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:47.129886 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:47.129931 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:47.130137 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.130948 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.132585 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.133169 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.133253 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.133264 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:47.133461 (+ 197us) server_negotiation.cc:299] Negotiation successful
0929 06:33:47.133503 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260929 06:33:47.133579 11081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.129777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:51305 (local address 127.9.61.65:35263)
0929 06:33:47.129849 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:47.129852 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:47.129990 (+ 138us) server_negotiation.cc:407] Connection header received
0929 06:33:47.130071 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:47.130072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:47.130083 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:47.130163 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:47.130303 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.130982 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.132584 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.133169 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.133253 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.133264 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:47.133461 (+ 197us) server_negotiation.cc:299] Negotiation successful
0929 06:33:47.133503 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 06:33:47.133634 10812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.129543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:37675 (local address 127.9.61.66:60121)
0929 06:33:47.129611 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:47.129624 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:47.129673 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:47.129968 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:47.129969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:47.129972 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:47.130049 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.130052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.131060 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.131061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.132462 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.132468 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.133266 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.133267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.133371 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.133378 (+ 7us) client_negotiation.cc:769] Sending connection context
0929 06:33:47.133438 (+ 60us) client_negotiation.cc:240] Negotiation successful
0929 06:33:47.133495 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":110}
I20260929 06:33:47.133641 11091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.129686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:35263 (local address 127.9.61.66:51305)
0929 06:33:47.129860 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:47.129871 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:47.129970 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:47.130178 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:47.130178 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:47.130180 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:47.130230 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.130231 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.131060 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.131061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.132462 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.132468 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.133266 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.133267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.133371 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.133378 (+ 7us) client_negotiation.cc:769] Sending connection context
0929 06:33:47.133438 (+ 60us) client_negotiation.cc:240] Negotiation successful
0929 06:33:47.133490 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":82,"thread_start_us":110,"threads_started":1}
I20260929 06:33:47.134130 10733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c114b2bbd1f04feda2ce275d7fe4cc29" candidate_uuid: "bb668699d7db4d779489a3034a423cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" is_pre_election: true
I20260929 06:33:47.134311 10733 raft_consensus.cc:2454] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb668699d7db4d779489a3034a423cfa in term 0.
I20260929 06:33:47.134331 11013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c114b2bbd1f04feda2ce275d7fe4cc29" candidate_uuid: "bb668699d7db4d779489a3034a423cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c887beabb5574642b743c0c12b692a88" is_pre_election: true
I20260929 06:33:47.134464 11013 raft_consensus.cc:2454] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb668699d7db4d779489a3034a423cfa in term 0.
I20260929 06:33:47.134632 10805 leader_election.cc:302] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6b586048da3499eb3c7c6441d6ccd8e, bb668699d7db4d779489a3034a423cfa; no voters:
I20260929 06:33:47.134749 11087 raft_consensus.cc:2781] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:33:47.134835 11087 raft_consensus.cc:482] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:33:47.134865 11087 raft_consensus.cc:3037] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:47.135919 11087 raft_consensus.cc:504] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } }
I20260929 06:33:47.136139 11087 leader_election.cc:288] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [CANDIDATE]: Term 1 election: Requested vote from peers c887beabb5574642b743c0c12b692a88 (127.9.61.67:37675), b6b586048da3499eb3c7c6441d6ccd8e (127.9.61.65:35263)
I20260929 06:33:47.136320 11013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c114b2bbd1f04feda2ce275d7fe4cc29" candidate_uuid: "bb668699d7db4d779489a3034a423cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c887beabb5574642b743c0c12b692a88"
I20260929 06:33:47.136354 10733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c114b2bbd1f04feda2ce275d7fe4cc29" candidate_uuid: "bb668699d7db4d779489a3034a423cfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6b586048da3499eb3c7c6441d6ccd8e"
I20260929 06:33:47.136423 10733 raft_consensus.cc:3037] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:47.136448 11013 raft_consensus.cc:3037] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:47.137447 11013 raft_consensus.cc:2454] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb668699d7db4d779489a3034a423cfa in term 1.
I20260929 06:33:47.137465 10733 raft_consensus.cc:2454] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb668699d7db4d779489a3034a423cfa in term 1.
I20260929 06:33:47.137671 10805 leader_election.cc:302] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6b586048da3499eb3c7c6441d6ccd8e, bb668699d7db4d779489a3034a423cfa; no voters:
I20260929 06:33:47.137807 11087 raft_consensus.cc:2781] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:47.137986 11087 raft_consensus.cc:686] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 1 LEADER]: Becoming Leader. State: Replica: bb668699d7db4d779489a3034a423cfa, State: Running, Role: LEADER
I20260929 06:33:47.138085 11087 consensus_queue.cc:237] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } }
I20260929 06:33:47.138896 10576 catalog_manager.cc:5495] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa reported cstate change: term changed from 0 to 1, leader changed from <none> to bb668699d7db4d779489a3034a423cfa (127.9.61.66). New cstate: current_term: 1 leader_uuid: "bb668699d7db4d779489a3034a423cfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } health_report { overall_health: UNKNOWN } } }
I20260929 06:33:47.145942 11078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.143367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50356 (local address 127.9.61.66:42769)
0929 06:33:47.143411 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:47.143431 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:47.143466 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:33:47.143592 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:47.143593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:47.143611 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:47.143670 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:47.143807 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.144330 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.145171 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.145357 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.145413 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.145595 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:47.145687 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:47.145747 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:47.145787 (+ 40us) server_negotiation.cc:299] Negotiation successful
0929 06:33:47.145804 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:33:47.147818 10733 raft_consensus.cc:1261] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e [term 1 FOLLOWER]: Refusing update from remote peer bb668699d7db4d779489a3034a423cfa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:47.147818 11013 raft_consensus.cc:1261] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88 [term 1 FOLLOWER]: Refusing update from remote peer bb668699d7db4d779489a3034a423cfa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:47.148219 11087 consensus_queue.cc:1035] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:47.148398 11092 consensus_queue.cc:1035] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:47.150904 11095 mvcc.cc:205] Tried to move back new op lower bound from 7334558216794476544 to 7334558216758214656. Current Snapshot: MvccSnapshot[applied={T|T < 7334558216794476544}]
I20260929 06:33:47.155318 10576 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:33:47.155437 10576 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:33:47.156286 10576 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5: Sending DeleteTablet for 3 replicas of tablet c114b2bbd1f04feda2ce275d7fe4cc29
I20260929 06:33:47.156625 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet c114b2bbd1f04feda2ce275d7fe4cc29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:47 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:50350
I20260929 06:33:47.156620 10993 tablet_service.cc:1514] Processing DeleteTablet for tablet c114b2bbd1f04feda2ce275d7fe4cc29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:47 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:53772
I20260929 06:33:47.156677 10713 tablet_service.cc:1514] Processing DeleteTablet for tablet c114b2bbd1f04feda2ce275d7fe4cc29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:47 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:39350
I20260929 06:33:47.156857 11105 tablet_replica.cc:330] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88: stopping tablet replica
I20260929 06:33:47.156963 11105 raft_consensus.cc:2229] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:33:47.157084 11105 raft_consensus.cc:2258] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:47.157081 11107 tablet_replica.cc:330] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa: stopping tablet replica
I20260929 06:33:47.157204 10576 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:33:47.157377 10576 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:33:47.157575 11105 ts_tablet_manager.cc:1905] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:47.158612 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 2525ee29b8914a31a4ce4bb0a41b5163 (DEFAULT_TABLE table=test-table [id=c302b8e74c834351bb06b229445cf005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:47.158615 10993 tablet_service.cc:1467] Processing CreateTablet for tablet 2525ee29b8914a31a4ce4bb0a41b5163 (DEFAULT_TABLE table=test-table [id=c302b8e74c834351bb06b229445cf005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:47.158725 10993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2525ee29b8914a31a4ce4bb0a41b5163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:47.158733 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2525ee29b8914a31a4ce4bb0a41b5163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:47.159861 11082 tablet_bootstrap.cc:492] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa: Bootstrap starting.
I20260929 06:33:47.160032 11086 tablet_bootstrap.cc:492] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88: Bootstrap starting.
I20260929 06:33:47.160398 11086 tablet_bootstrap.cc:654] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:47.161128 11105 ts_tablet_manager.cc:1918] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:33:47.161150 11082 tablet_bootstrap.cc:654] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:47.161211 11105 log.cc:1196] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/c114b2bbd1f04feda2ce275d7fe4cc29
I20260929 06:33:47.161458 11105 ts_tablet_manager.cc:1939] T c114b2bbd1f04feda2ce275d7fe4cc29 P c887beabb5574642b743c0c12b692a88: Deleting consensus metadata
I20260929 06:33:47.161724 11086 tablet_bootstrap.cc:492] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88: No bootstrap required, opened a new log
I20260929 06:33:47.161791 11086 ts_tablet_manager.cc:1397] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:33:47.161975 10561 catalog_manager.cc:4841] TS c887beabb5574642b743c0c12b692a88 (127.9.61.67:37675): tablet c114b2bbd1f04feda2ce275d7fe4cc29 (table test-table [id=a7e42f7a478748b7b11e6f2f8211bef8]) successfully deleted
I20260929 06:33:47.161968 11086 raft_consensus.cc:348] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.162050 11086 raft_consensus.cc:374] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:47.162079 11086 raft_consensus.cc:729] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c887beabb5574642b743c0c12b692a88, State: Initialized, Role: FOLLOWER
I20260929 06:33:47.162129 11086 consensus_queue.cc:260] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.162235 11086 ts_tablet_manager.cc:1428] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:47.157691 11106 tablet_replica.cc:330] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e: stopping tablet replica
I20260929 06:33:47.158605 10713 tablet_service.cc:1467] Processing CreateTablet for tablet 2525ee29b8914a31a4ce4bb0a41b5163 (DEFAULT_TABLE table=test-table [id=c302b8e74c834351bb06b229445cf005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:47.162393 10713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2525ee29b8914a31a4ce4bb0a41b5163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:47.163851 11083 tablet_bootstrap.cc:492] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e: Bootstrap starting.
I20260929 06:33:47.164047 11082 tablet_bootstrap.cc:492] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa: No bootstrap required, opened a new log
I20260929 06:33:47.164100 11082 ts_tablet_manager.cc:1397] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260929 06:33:47.164259 11082 raft_consensus.cc:348] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.164296 11083 tablet_bootstrap.cc:654] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:47.164352 11082 raft_consensus.cc:374] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:47.164381 11082 raft_consensus.cc:729] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb668699d7db4d779489a3034a423cfa, State: Initialized, Role: FOLLOWER
I20260929 06:33:47.164425 11082 consensus_queue.cc:260] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.164762 11082 ts_tablet_manager.cc:1428] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260929 06:33:47.165069 11106 raft_consensus.cc:2229] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:33:47.165287 11107 raft_consensus.cc:2229] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:33:47.165345 11083 tablet_bootstrap.cc:492] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e: No bootstrap required, opened a new log
I20260929 06:33:47.165395 11083 ts_tablet_manager.cc:1397] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:33:47.165450 11107 raft_consensus.cc:2258] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:47.165629 11083 raft_consensus.cc:348] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.165735 11083 raft_consensus.cc:374] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:47.165758 11083 raft_consensus.cc:729] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6b586048da3499eb3c7c6441d6ccd8e, State: Initialized, Role: FOLLOWER
I20260929 06:33:47.165810 11083 consensus_queue.cc:260] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.165925 11083 ts_tablet_manager.cc:1428] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260929 06:33:47.166105 11106 raft_consensus.cc:2258] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:47.166590 11107 ts_tablet_manager.cc:1905] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:47.166677 11106 ts_tablet_manager.cc:1905] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:47.168032 11107 ts_tablet_manager.cc:1918] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:33:47.168128 11107 log.cc:1196] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/c114b2bbd1f04feda2ce275d7fe4cc29
I20260929 06:33:47.168375 11107 ts_tablet_manager.cc:1939] T c114b2bbd1f04feda2ce275d7fe4cc29 P bb668699d7db4d779489a3034a423cfa: Deleting consensus metadata
I20260929 06:33:47.168421 11106 ts_tablet_manager.cc:1918] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:33:47.168501 11106 log.cc:1196] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/wal/wals/c114b2bbd1f04feda2ce275d7fe4cc29
I20260929 06:33:47.168773 10562 catalog_manager.cc:4841] TS bb668699d7db4d779489a3034a423cfa (127.9.61.66:42769): tablet c114b2bbd1f04feda2ce275d7fe4cc29 (table test-table [id=a7e42f7a478748b7b11e6f2f8211bef8]) successfully deleted
I20260929 06:33:47.169092 11106 ts_tablet_manager.cc:1939] T c114b2bbd1f04feda2ce275d7fe4cc29 P b6b586048da3499eb3c7c6441d6ccd8e: Deleting consensus metadata
W20260929 06:33:47.169450 11060 tablet.cc:2369] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:33:47.169490 10561 catalog_manager.cc:4841] TS b6b586048da3499eb3c7c6441d6ccd8e (127.9.61.65:35263): tablet c114b2bbd1f04feda2ce275d7fe4cc29 (table test-table [id=a7e42f7a478748b7b11e6f2f8211bef8]) successfully deleted
I20260929 06:33:47.197623 11090 raft_consensus.cc:482] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:33:47.197758 11090 raft_consensus.cc:504] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.198169 11090 leader_election.cc:288] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6b586048da3499eb3c7c6441d6ccd8e (127.9.61.65:35263), bb668699d7db4d779489a3034a423cfa (127.9.61.66:42769)
I20260929 06:33:47.201578 11081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.198405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:46855 (local address 127.9.61.65:35263)
0929 06:33:47.198450 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:47.198452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:47.198609 (+ 157us) server_negotiation.cc:407] Connection header received
0929 06:33:47.198643 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:47.198644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:47.198656 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:47.198716 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:47.198904 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.199658 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.200760 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.201184 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.201273 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.201284 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:47.201456 (+ 172us) server_negotiation.cc:299] Negotiation successful
0929 06:33:47.201495 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:33:47.201599 11111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.198346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:35263 (local address 127.9.61.67:46855)
0929 06:33:47.198511 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:47.198521 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:47.198591 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:47.198732 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:47.198733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:47.198735 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:47.198820 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.198822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.199764 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.199765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.200663 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.200666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.201301 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.201302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.201374 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.201379 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:33:47.201442 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 06:33:47.201482 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":16,"thread_start_us":80,"threads_started":1}
I20260929 06:33:47.201869 10733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2525ee29b8914a31a4ce4bb0a41b5163" candidate_uuid: "c887beabb5574642b743c0c12b692a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" is_pre_election: true
I20260929 06:33:47.201964 10733 raft_consensus.cc:2454] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c887beabb5574642b743c0c12b692a88 in term 0.
I20260929 06:33:47.202005 10952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.198346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:42769 (local address 127.9.61.67:59249)
0929 06:33:47.198503 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:47.198515 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:47.198560 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:47.198784 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:47.198785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:47.198793 (+ 8us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:47.198840 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.198841 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.199735 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.199736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.201013 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.201016 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.201741 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.201742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.201842 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.201845 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:33:47.201895 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 06:33:47.201938 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138}
I20260929 06:33:47.202142 10945 leader_election.cc:302] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6b586048da3499eb3c7c6441d6ccd8e, c887beabb5574642b743c0c12b692a88; no voters:
I20260929 06:33:47.202268 11078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.198462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:59249 (local address 127.9.61.66:42769)
0929 06:33:47.198655 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:47.198658 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:47.198666 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:33:47.198689 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:47.198690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:47.198700 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:47.198745 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:47.198933 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.199644 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.201111 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.201631 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.201699 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.201710 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:47.202159 (+ 449us) server_negotiation.cc:299] Negotiation successful
0929 06:33:47.202199 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260929 06:33:47.202270 11090 raft_consensus.cc:2781] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:33:47.202312 11090 raft_consensus.cc:482] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:33:47.202333 11090 raft_consensus.cc:3037] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:47.202474 10873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2525ee29b8914a31a4ce4bb0a41b5163" candidate_uuid: "c887beabb5574642b743c0c12b692a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb668699d7db4d779489a3034a423cfa" is_pre_election: true
I20260929 06:33:47.202618 10873 raft_consensus.cc:2454] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c887beabb5574642b743c0c12b692a88 in term 0.
I20260929 06:33:47.203184 11090 raft_consensus.cc:504] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.203343 11090 leader_election.cc:288] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [CANDIDATE]: Term 1 election: Requested vote from peers b6b586048da3499eb3c7c6441d6ccd8e (127.9.61.65:35263), bb668699d7db4d779489a3034a423cfa (127.9.61.66:42769)
I20260929 06:33:47.203495 10733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2525ee29b8914a31a4ce4bb0a41b5163" candidate_uuid: "c887beabb5574642b743c0c12b692a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6b586048da3499eb3c7c6441d6ccd8e"
I20260929 06:33:47.203568 10733 raft_consensus.cc:3037] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:47.203590 10873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2525ee29b8914a31a4ce4bb0a41b5163" candidate_uuid: "c887beabb5574642b743c0c12b692a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb668699d7db4d779489a3034a423cfa"
I20260929 06:33:47.203655 10873 raft_consensus.cc:3037] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:47.204478 10873 raft_consensus.cc:2454] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c887beabb5574642b743c0c12b692a88 in term 1.
I20260929 06:33:47.204478 10733 raft_consensus.cc:2454] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c887beabb5574642b743c0c12b692a88 in term 1.
I20260929 06:33:47.204650 10946 leader_election.cc:302] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb668699d7db4d779489a3034a423cfa, c887beabb5574642b743c0c12b692a88; no voters:
I20260929 06:33:47.204742 11090 raft_consensus.cc:2781] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:47.204873 11090 raft_consensus.cc:686] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 1 LEADER]: Becoming Leader. State: Replica: c887beabb5574642b743c0c12b692a88, State: Running, Role: LEADER
I20260929 06:33:47.204957 11090 consensus_queue.cc:237] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.205641 10576 catalog_manager.cc:5495] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to c887beabb5574642b743c0c12b692a88 (127.9.61.67). New cstate: current_term: 1 leader_uuid: "c887beabb5574642b743c0c12b692a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } health_report { overall_health: HEALTHY } } }
Sep 29 06:33:47 dist-test-slave-601b krb5kdc[10531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:47.256755 11119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.248717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41695 (local address 127.0.0.1:48354)
0929 06:33:47.248928 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:47.248939 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:47.249006 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:47.249173 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:47.249174 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:47.249463 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:47.249509 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.249511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.250469 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.250470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.250993 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.250994 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.251489 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.251490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.251535 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.252127 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:47.252132 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:47.253804 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:47.255635 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:47.255642 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:47.255658 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:47.255967 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:47.256172 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:47.256172 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:47.256172 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:47.256229 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:47.256495 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:47.256501 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:47.256542 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 06:33:47.256595 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:33:47.256683 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":100,"threads_started":1}
I20260929 06:33:47.256850 10639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.248813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48354 (local address 127.9.61.126:41695)
0929 06:33:47.248892 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:47.248894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:47.249006 (+ 112us) server_negotiation.cc:407] Connection header received
0929 06:33:47.249062 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:47.249063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:47.249079 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:47.249158 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:47.249586 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.250374 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.251101 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.251418 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.251490 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.253902 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:47.253904 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:47.253904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:47.253911 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:47.255552 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:47.256042 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:47.256044 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:47.256044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:47.256106 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:47.256293 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:47.256294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:47.256295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:47.256429 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:47.256500 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:47.256642 (+ 142us) server_negotiation.cc:299] Negotiation successful
0929 06:33:47.256744 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":41}
I20260929 06:33:47.259232 10576 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:48354:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260929 06:33:47.259461 10576 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:33:47.261054 10853 tablet_service.cc:1467] Processing CreateTablet for tablet d242c9741662473d97fd33f4d81fe317 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e66fc282bc794ec89ac8103fbdda4d07]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:33:47.261066 10993 tablet_service.cc:1467] Processing CreateTablet for tablet d242c9741662473d97fd33f4d81fe317 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e66fc282bc794ec89ac8103fbdda4d07]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:33:47.261215 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d242c9741662473d97fd33f4d81fe317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:47.261231 10993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d242c9741662473d97fd33f4d81fe317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:47.262653 11086 tablet_bootstrap.cc:492] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: Bootstrap starting.
I20260929 06:33:47.262750 10713 tablet_service.cc:1467] Processing CreateTablet for tablet d242c9741662473d97fd33f4d81fe317 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e66fc282bc794ec89ac8103fbdda4d07]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:33:47.262785 11082 tablet_bootstrap.cc:492] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa: Bootstrap starting.
I20260929 06:33:47.262892 10713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d242c9741662473d97fd33f4d81fe317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:47.263105 11086 tablet_bootstrap.cc:654] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:47.263188 11082 tablet_bootstrap.cc:654] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:47.264017 11082 tablet_bootstrap.cc:492] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa: No bootstrap required, opened a new log
I20260929 06:33:47.264066 11082 ts_tablet_manager.cc:1397] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:33:47.264200 11082 raft_consensus.cc:348] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.264266 11082 raft_consensus.cc:374] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:47.264283 11082 raft_consensus.cc:729] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb668699d7db4d779489a3034a423cfa, State: Initialized, Role: FOLLOWER
I20260929 06:33:47.264319 11082 consensus_queue.cc:260] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.264393 11082 ts_tablet_manager.cc:1428] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:47.264467 11083 tablet_bootstrap.cc:492] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e: Bootstrap starting.
I20260929 06:33:47.264494 11101 tablet_replica.cc:439] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } }
I20260929 06:33:47.264555 11101 tablet_replica.cc:442] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:47.264889 11083 tablet_bootstrap.cc:654] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:47.265533 11083 tablet_bootstrap.cc:492] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e: No bootstrap required, opened a new log
I20260929 06:33:47.265584 11083 ts_tablet_manager.cc:1397] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:47.265712 11086 tablet_bootstrap.cc:492] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: No bootstrap required, opened a new log
I20260929 06:33:47.265769 11086 ts_tablet_manager.cc:1397] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 06:33:47.265731 11083 raft_consensus.cc:348] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.265826 11083 raft_consensus.cc:374] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:47.265852 11083 raft_consensus.cc:729] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6b586048da3499eb3c7c6441d6ccd8e, State: Initialized, Role: FOLLOWER
I20260929 06:33:47.265900 11083 consensus_queue.cc:260] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.266005 11083 ts_tablet_manager.cc:1428] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:47.266036 11086 raft_consensus.cc:348] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.266105 11086 raft_consensus.cc:374] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:47.266124 11086 raft_consensus.cc:729] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c887beabb5574642b743c0c12b692a88, State: Initialized, Role: FOLLOWER
I20260929 06:33:47.266165 11086 consensus_queue.cc:260] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.266237 11086 ts_tablet_manager.cc:1428] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:47.266371 11089 tablet_replica.cc:439] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } }
I20260929 06:33:47.266455 11089 tablet_replica.cc:442] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:47.266644 11090 tablet_replica.cc:439] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } }
I20260929 06:33:47.266716 11090 tablet_replica.cc:442] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:47.484217 11090 raft_consensus.cc:482] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:33:47.484342 11090 raft_consensus.cc:504] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.484555 11090 leader_election.cc:288] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6b586048da3499eb3c7c6441d6ccd8e (127.9.61.65:35263), bb668699d7db4d779489a3034a423cfa (127.9.61.66:42769)
I20260929 06:33:47.484827 10733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d242c9741662473d97fd33f4d81fe317" candidate_uuid: "c887beabb5574642b743c0c12b692a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" is_pre_election: true
I20260929 06:33:47.484827 10873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d242c9741662473d97fd33f4d81fe317" candidate_uuid: "c887beabb5574642b743c0c12b692a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb668699d7db4d779489a3034a423cfa" is_pre_election: true
I20260929 06:33:47.484925 10733 raft_consensus.cc:2454] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c887beabb5574642b743c0c12b692a88 in term 0.
I20260929 06:33:47.484925 10873 raft_consensus.cc:2454] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c887beabb5574642b743c0c12b692a88 in term 0.
I20260929 06:33:47.485062 10946 leader_election.cc:302] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb668699d7db4d779489a3034a423cfa, c887beabb5574642b743c0c12b692a88; no voters:
I20260929 06:33:47.485144 11090 raft_consensus.cc:2781] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:33:47.485181 11090 raft_consensus.cc:482] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:33:47.485199 11090 raft_consensus.cc:3037] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:47.485859 11090 raft_consensus.cc:504] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.485989 11090 leader_election.cc:288] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [CANDIDATE]: Term 1 election: Requested vote from peers b6b586048da3499eb3c7c6441d6ccd8e (127.9.61.65:35263), bb668699d7db4d779489a3034a423cfa (127.9.61.66:42769)
I20260929 06:33:47.486146 10733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d242c9741662473d97fd33f4d81fe317" candidate_uuid: "c887beabb5574642b743c0c12b692a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6b586048da3499eb3c7c6441d6ccd8e"
I20260929 06:33:47.486217 10733 raft_consensus.cc:3037] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:47.486142 10873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d242c9741662473d97fd33f4d81fe317" candidate_uuid: "c887beabb5574642b743c0c12b692a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb668699d7db4d779489a3034a423cfa"
I20260929 06:33:47.486256 10873 raft_consensus.cc:3037] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:47.486986 10733 raft_consensus.cc:2454] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c887beabb5574642b743c0c12b692a88 in term 1.
I20260929 06:33:47.487129 10873 raft_consensus.cc:2454] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c887beabb5574642b743c0c12b692a88 in term 1.
I20260929 06:33:47.487160 10945 leader_election.cc:302] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6b586048da3499eb3c7c6441d6ccd8e, c887beabb5574642b743c0c12b692a88; no voters:
I20260929 06:33:47.487232 11090 raft_consensus.cc:2781] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:47.487277 11090 raft_consensus.cc:686] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [term 1 LEADER]: Becoming Leader. State: Replica: c887beabb5574642b743c0c12b692a88, State: Running, Role: LEADER
I20260929 06:33:47.487326 11090 consensus_queue.cc:237] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } }
I20260929 06:33:47.487556 11112 tablet_replica.cc:439] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: TxnStatusTablet state changed. Reason: New leader c887beabb5574642b743c0c12b692a88. Latest consensus state: current_term: 1 leader_uuid: "c887beabb5574642b743c0c12b692a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } }
I20260929 06:33:47.487651 11112 tablet_replica.cc:442] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:33:47.487850 10576 catalog_manager.cc:5495] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to c887beabb5574642b743c0c12b692a88 (127.9.61.67). New cstate: current_term: 1 leader_uuid: "c887beabb5574642b743c0c12b692a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } health_report { overall_health: HEALTHY } } }
I20260929 06:33:47.488209 11124 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260929 06:33:47.488340 11124 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260929 06:33:47.547992 11080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.545233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53778 (local address 127.9.61.67:37675)
0929 06:33:47.545279 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:47.545281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:47.545309 (+ 28us) server_negotiation.cc:407] Connection header received
0929 06:33:47.545410 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:47.545410 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:47.545427 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:47.545484 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:47.545620 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.546140 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.547225 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.547403 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.547455 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.547652 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:47.547738 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:47.547791 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:47.547868 (+ 77us) server_negotiation.cc:299] Negotiation successful
0929 06:33:47.547889 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:33:47.548012 11119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.545178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:37675 (local address 127.0.0.1:53778)
0929 06:33:47.545260 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:47.545273 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:47.545330 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:47.545500 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:47.545501 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:47.545503 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:33:47.545556 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.545559 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.546221 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.546222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.547141 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.547144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.547480 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.547481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.547548 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.547564 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:33:47.547800 (+ 236us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:33:47.547807 (+ 7us) client_negotiation.cc:769] Sending connection context
0929 06:33:47.547864 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 06:33:47.547910 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260929 06:33:47.549094 10733 raft_consensus.cc:1261] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e [term 1 FOLLOWER]: Refusing update from remote peer c887beabb5574642b743c0c12b692a88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:47.549218 10873 raft_consensus.cc:1261] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa [term 1 FOLLOWER]: Refusing update from remote peer c887beabb5574642b743c0c12b692a88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:47.549372 11112 consensus_queue.cc:1035] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:47.549479 11090 consensus_queue.cc:1035] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:47.550138 11101 tablet_replica.cc:439] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa: TxnStatusTablet state changed. Reason: New leader c887beabb5574642b743c0c12b692a88. Latest consensus state: current_term: 1 leader_uuid: "c887beabb5574642b743c0c12b692a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } }
I20260929 06:33:47.550127 11089 tablet_replica.cc:439] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e: TxnStatusTablet state changed. Reason: New leader c887beabb5574642b743c0c12b692a88. Latest consensus state: current_term: 1 leader_uuid: "c887beabb5574642b743c0c12b692a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } }
I20260929 06:33:47.550215 11101 tablet_replica.cc:442] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:47.550215 11089 tablet_replica.cc:442] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:47.551002 11112 tablet_replica.cc:439] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c887beabb5574642b743c0c12b692a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } }
I20260929 06:33:47.551090 11112 tablet_replica.cc:442] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:33:47.551146 11112 tablet_replica.cc:439] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c887beabb5574642b743c0c12b692a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } }
I20260929 06:33:47.551194 11112 tablet_replica.cc:442] T d242c9741662473d97fd33f4d81fe317 P c887beabb5574642b743c0c12b692a88: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:33:47.551246 11097 mvcc.cc:205] Tried to move back new op lower bound from 7334558218439172096 to 7334558218188423168. Current Snapshot: MvccSnapshot[applied={T|T < 7334558218439172096}]
I20260929 06:33:47.551425 11096 mvcc.cc:205] Tried to move back new op lower bound from 7334558218439172096 to 7334558218188423168. Current Snapshot: MvccSnapshot[applied={T|T < 7334558218439172096}]
I20260929 06:33:47.551501 11101 tablet_replica.cc:439] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c887beabb5574642b743c0c12b692a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } }
I20260929 06:33:47.551501 11089 tablet_replica.cc:439] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c887beabb5574642b743c0c12b692a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 } } peers { permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 } } peers { permanent_uuid: "c887beabb5574642b743c0c12b692a88" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 37675 } } }
I20260929 06:33:47.551574 11089 tablet_replica.cc:442] T d242c9741662473d97fd33f4d81fe317 P b6b586048da3499eb3c7c6441d6ccd8e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:47.551574 11101 tablet_replica.cc:442] T d242c9741662473d97fd33f4d81fe317 P bb668699d7db4d779489a3034a423cfa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:47.555487 11080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.553327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53780 (local address 127.9.61.67:37675)
0929 06:33:47.553360 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:47.553362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:47.553371 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:33:47.553426 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:47.553426 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:47.553436 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:47.553496 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:47.553601 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.554049 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.554774 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.555013 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.555088 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.555235 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:47.555265 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:47.555332 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:47.555390 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 06:33:47.555409 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:33:47.560122 11080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.557868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:49755 (local address 127.9.61.67:37675)
0929 06:33:47.557905 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:47.557907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:47.558011 (+ 104us) server_negotiation.cc:407] Connection header received
0929 06:33:47.558076 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:47.558076 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:47.558083 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:47.558130 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:47.558241 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.558647 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.559382 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.559584 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.559664 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.559830 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:47.559863 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:47.559923 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:47.560013 (+ 90us) server_negotiation.cc:299] Negotiation successful
0929 06:33:47.560046 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":15,"server-negotiator.queue_time_us":19}
I20260929 06:33:47.560192 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.557786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:37675 (local address 127.9.61.67:49755)
0929 06:33:47.557937 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:47.557945 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:47.558025 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:47.558134 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:47.558134 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:47.558135 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:33:47.558183 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.558184 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.558722 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.558723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.559288 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:47.559290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.559665 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.559666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:47.559724 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.559739 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:33:47.559923 (+ 184us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:33:47.559925 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:33:47.560009 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 06:33:47.560062 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":5,"thread_start_us":78,"threads_started":1}
I20260929 06:33:47.562247 10873 raft_consensus.cc:1261] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa [term 1 FOLLOWER]: Refusing update from remote peer c887beabb5574642b743c0c12b692a88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:47.562251 10733 raft_consensus.cc:1261] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e [term 1 FOLLOWER]: Refusing update from remote peer c887beabb5574642b743c0c12b692a88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:47.562457 11112 consensus_queue.cc:1035] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6b586048da3499eb3c7c6441d6ccd8e" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:47.562561 11090 consensus_queue.cc:1035] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb668699d7db4d779489a3034a423cfa" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:47.577363 10576 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:33:47.577492 10576 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:33:47.578194 10576 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 20748f49925f462b880be339d609c8d5: Sending DeleteTablet for 3 replicas of tablet 2525ee29b8914a31a4ce4bb0a41b5163
I20260929 06:33:47.578424 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 2525ee29b8914a31a4ce4bb0a41b5163 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:47 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:50350
I20260929 06:33:47.578438 10713 tablet_service.cc:1514] Processing DeleteTablet for tablet 2525ee29b8914a31a4ce4bb0a41b5163 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:47 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:39350
I20260929 06:33:47.578536 11106 tablet_replica.cc:330] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e: stopping tablet replica
I20260929 06:33:47.578542 11107 tablet_replica.cc:330] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa: stopping tablet replica
I20260929 06:33:47.578585 11107 raft_consensus.cc:2229] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:33:47.578586 11106 raft_consensus.cc:2229] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:33:47.578619 11106 raft_consensus.cc:2258] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:47.578619 11107 raft_consensus.cc:2258] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:47.578931 11107 ts_tablet_manager.cc:1905] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:47.578928 11106 ts_tablet_manager.cc:1905] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:47.580346 11107 ts_tablet_manager.cc:1918] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:33:47.580425 11107 log.cc:1196] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/2525ee29b8914a31a4ce4bb0a41b5163
I20260929 06:33:47.580554 11106 ts_tablet_manager.cc:1918] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:33:47.580618 11106 log.cc:1196] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-0/wal/wals/2525ee29b8914a31a4ce4bb0a41b5163
I20260929 06:33:47.580677 11107 ts_tablet_manager.cc:1939] T 2525ee29b8914a31a4ce4bb0a41b5163 P bb668699d7db4d779489a3034a423cfa: Deleting consensus metadata
I20260929 06:33:47.580837 11106 ts_tablet_manager.cc:1939] T 2525ee29b8914a31a4ce4bb0a41b5163 P b6b586048da3499eb3c7c6441d6ccd8e: Deleting consensus metadata
I20260929 06:33:47.580997 10562 catalog_manager.cc:4841] TS bb668699d7db4d779489a3034a423cfa (127.9.61.66:42769): tablet 2525ee29b8914a31a4ce4bb0a41b5163 (table test-table [id=c302b8e74c834351bb06b229445cf005]) successfully deleted
I20260929 06:33:47.581157 10561 catalog_manager.cc:4841] TS b6b586048da3499eb3c7c6441d6ccd8e (127.9.61.65:35263): tablet 2525ee29b8914a31a4ce4bb0a41b5163 (table test-table [id=c302b8e74c834351bb06b229445cf005]) successfully deleted
I20260929 06:33:47.581326 10993 tablet_service.cc:1514] Processing DeleteTablet for tablet 2525ee29b8914a31a4ce4bb0a41b5163 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:47 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:53772
I20260929 06:33:47.581561 11105 tablet_replica.cc:330] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88: stopping tablet replica
I20260929 06:33:47.581634 11105 raft_consensus.cc:2229] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:33:47.581730 11105 raft_consensus.cc:2258] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:47.582041 11105 ts_tablet_manager.cc:1905] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:47.583269 11105 ts_tablet_manager.cc:1918] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:33:47.583328 11105 log.cc:1196] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/2525ee29b8914a31a4ce4bb0a41b5163
I20260929 06:33:47.583536 11105 ts_tablet_manager.cc:1939] T 2525ee29b8914a31a4ce4bb0a41b5163 P c887beabb5574642b743c0c12b692a88: Deleting consensus metadata
I20260929 06:33:47.583839 10561 catalog_manager.cc:4841] TS c887beabb5574642b743c0c12b692a88 (127.9.61.67:37675): tablet 2525ee29b8914a31a4ce4bb0a41b5163 (table test-table [id=c302b8e74c834351bb06b229445cf005]) successfully deleted
Sep 29 06:33:47 dist-test-slave-601b krb5kdc[10531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663626, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.61.65@KRBTEST.COM
I20260929 06:33:47.591082 11081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.581731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39362 (local address 127.9.61.65:35263)
0929 06:33:47.581782 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:47.581784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:47.582037 (+ 253us) server_negotiation.cc:407] Connection header received
0929 06:33:47.582070 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:47.582071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:47.582082 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:47.582151 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:47.582911 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.583661 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.584743 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.584919 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.584975 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.588098 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:47.588106 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:47.588107 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:47.588114 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:47.589765 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:47.590206 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:47.590209 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:47.590210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:47.590269 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:47.590507 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:47.590508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:47.590508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:47.590655 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:47.590797 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:47.590894 (+ 97us) server_negotiation.cc:299] Negotiation successful
0929 06:33:47.590984 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260929 06:33:47.591355 10773 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39362
I20260929 06:33:47.599390 10639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:47.592320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48360 (local address 127.9.61.126:41695)
0929 06:33:47.592364 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:47.592366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:47.592422 (+ 56us) server_negotiation.cc:407] Connection header received
0929 06:33:47.592488 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:47.592489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:47.592499 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:47.592554 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:47.593106 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.593858 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.594882 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:47.595175 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:47.595253 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:47.596728 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:47.596730 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:47.596730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:47.596738 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:47.598365 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:47.598678 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:47.598679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:47.598679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:47.598743 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:47.598918 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:47.598919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:47.598919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:47.599053 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:47.599163 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:47.599225 (+ 62us) server_negotiation.cc:299] Negotiation successful
0929 06:33:47.599297 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 06:33:47.599740 10576 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48360
I20260929 06:33:47.600437 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 10648
I20260929 06:33:47.606775 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 10788
I20260929 06:33:47.612612 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 10928
I20260929 06:33:47.618176 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 10544
2026-09-29T06:33:47Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2573 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:33:47 dist-test-slave-601b krb5kdc[11143](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:33:47 dist-test-slave-601b krb5kdc[11143](info): set up 2 sockets
Sep 29 06:33:47 dist-test-slave-601b krb5kdc[11143](info): commencing operation
krb5kdc: starting...
W20260929 06:33:48.651624 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:33:48 dist-test-slave-601b krb5kdc[11143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:33:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:33:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:33:48.770939 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:37685
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:37685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:48.852815 11156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:48.853070 11156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:48.853108 11156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:48.854272 11156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:33:48.854342 11156 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260929 06:33:48.854364 11156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:48.854386 11156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:48.854414 11156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:33:48.854439 11156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:33:48.855890 11156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:37685
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:37685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:48.856205 11156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:48.856436 11156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:48.861197 11164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:48.861197 11161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:48.861266 11156 server_base.cc:1034] running on GCE node
W20260929 06:33:48.861238 11162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:48.861575 11156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:48.861925 11156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:48.863087 11156 hybrid_clock.cc:648] HybridClock initialized: now 1790663628863073 us; error 43 us; skew 500 ppm
Sep 29 06:33:48 dist-test-slave-601b krb5kdc[11143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663628, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:48.865772 11156 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:33:48.866251 11156 webserver.cc:460] Webserver started at http://127.9.61.126:46859/ using document root <none> and password file <none>
I20260929 06:33:48.866482 11156 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:48.866528 11156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:48.866662 11156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:48.867748 11156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "e744d69edb524e97923255dd0562aa5e"
format_stamp: "Formatted at 2026-09-29 06:33:48 on dist-test-slave-601b"
server_key: "b1eab57ea70a3484c9ed7e1af9e55feb"
server_key_iv: "017199cfb67cb3c0c302a4f1d116eb87"
server_key_version: "encryptionkey@0"
I20260929 06:33:48.868149 11156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "e744d69edb524e97923255dd0562aa5e"
format_stamp: "Formatted at 2026-09-29 06:33:48 on dist-test-slave-601b"
server_key: "b1eab57ea70a3484c9ed7e1af9e55feb"
server_key_iv: "017199cfb67cb3c0c302a4f1d116eb87"
server_key_version: "encryptionkey@0"
I20260929 06:33:48.869534 11156 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:33:48.870332 11171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:48.870519 11156 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:33:48.870626 11156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "e744d69edb524e97923255dd0562aa5e"
format_stamp: "Formatted at 2026-09-29 06:33:48 on dist-test-slave-601b"
server_key: "b1eab57ea70a3484c9ed7e1af9e55feb"
server_key_iv: "017199cfb67cb3c0c302a4f1d116eb87"
server_key_version: "encryptionkey@0"
I20260929 06:33:48.870704 11156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:48.878048 11156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:48.880034 11156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:48.880203 11156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:48.884881 11156 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:37685
I20260929 06:33:48.884933 11233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:37685 every 8 connection(s)
I20260929 06:33:48.885270 11156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:33:48.885774 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 11156
I20260929 06:33:48.885849 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:33:48.885962 11234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:48.886065 9461 external_mini_cluster.cc:1428] Setting key 9bc09f548d201eaee3c75430d3cf75c1
I20260929 06:33:48.889410 11234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e: Bootstrap starting.
I20260929 06:33:48.890121 11234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:48.890419 11234 log.cc:824] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:48.891165 11234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e: No bootstrap required, opened a new log
Sep 29 06:33:48 dist-test-slave-601b krb5kdc[11143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:48.893785 11234 raft_consensus.cc:348] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e744d69edb524e97923255dd0562aa5e" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37685 } }
I20260929 06:33:48.893930 11234 raft_consensus.cc:374] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:48.893958 11234 raft_consensus.cc:729] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e744d69edb524e97923255dd0562aa5e, State: Initialized, Role: FOLLOWER
I20260929 06:33:48.894122 11234 consensus_queue.cc:260] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e744d69edb524e97923255dd0562aa5e" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37685 } }
I20260929 06:33:48.894207 11234 raft_consensus.cc:388] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:33:48.894243 11234 raft_consensus.cc:482] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:33:48.894313 11234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:48.894893 11234 raft_consensus.cc:504] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e744d69edb524e97923255dd0562aa5e" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37685 } }
I20260929 06:33:48.895020 11234 leader_election.cc:302] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e744d69edb524e97923255dd0562aa5e; no voters:
I20260929 06:33:48.895242 11234 leader_election.cc:288] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:33:48.895272 11239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:48.895419 11239 raft_consensus.cc:686] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [term 1 LEADER]: Becoming Leader. State: Replica: e744d69edb524e97923255dd0562aa5e, State: Running, Role: LEADER
I20260929 06:33:48.895529 11234 sys_catalog.cc:564] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:33:48.895532 11239 consensus_queue.cc:237] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e744d69edb524e97923255dd0562aa5e" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37685 } }
I20260929 06:33:48.895896 11240 sys_catalog.cc:455] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e744d69edb524e97923255dd0562aa5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e744d69edb524e97923255dd0562aa5e" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37685 } } }
I20260929 06:33:48.895995 11240 sys_catalog.cc:458] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [sys.catalog]: This master's current role is: LEADER
I20260929 06:33:48.896219 11241 sys_catalog.cc:455] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e744d69edb524e97923255dd0562aa5e. Latest consensus state: current_term: 1 leader_uuid: "e744d69edb524e97923255dd0562aa5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e744d69edb524e97923255dd0562aa5e" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37685 } } }
I20260929 06:33:48.896566 11241 sys_catalog.cc:458] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e [sys.catalog]: This master's current role is: LEADER
I20260929 06:33:48.896696 11245 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:33:48.897208 11245 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:33:48.898483 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:48.886636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34506 (local address 127.9.61.126:37685)
0929 06:33:48.886833 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:48.886843 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:48.886879 (+ 36us) server_negotiation.cc:407] Connection header received
0929 06:33:48.887598 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:48.887607 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:48.887675 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:48.887846 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:48.888484 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:48.889880 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:48.890694 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:48.891180 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:48.891315 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:48.894112 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:48.894117 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:48.894118 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:48.894131 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:48.896353 (+ 2222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:48.896789 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:48.896793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:48.896793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:48.896942 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:48.897247 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:48.897247 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:48.897248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:48.897530 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:48.897700 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:48.898065 (+ 365us) server_negotiation.cc:299] Negotiation successful
0929 06:33:48.898237 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":90,"threads_started":1}
I20260929 06:33:48.899293 11245 catalog_manager.cc:1347] Generated new cluster ID: ff9824e6c5ab44cab2e8e56049d9152b
I20260929 06:33:48.899358 11245 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:33:48.910208 11245 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:33:48.910966 11245 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:33:48.914481 11245 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e: Generated new TSK 0
I20260929 06:33:48.914700 11245 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:33:48.938963 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37685
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:49.021943 11260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:49.022135 11260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:49.022159 11260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:49.023289 11260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:49.023332 11260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:49.023351 11260 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260929 06:33:49.023363 11260 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:33:49.023404 11260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:33:49.024966 11260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.61.126:37685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:49.025213 11260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:49.025465 11260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:49.030496 11268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:49.030547 11265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:49.030596 11260 server_base.cc:1034] running on GCE node
W20260929 06:33:49.030496 11266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:49.030886 11260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:49.031152 11260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:49.032315 11260 hybrid_clock.cc:648] HybridClock initialized: now 1790663629032311 us; error 37 us; skew 500 ppm
Sep 29 06:33:49 dist-test-slave-601b krb5kdc[11143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663629, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:49.034818 11260 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:33:49.035259 11260 webserver.cc:460] Webserver started at http://127.9.61.65:39323/ using document root <none> and password file <none>
I20260929 06:33:49.035506 11260 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:49.035573 11260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:49.035722 11260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:49.036844 11260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "f06f5a52733b472b871a049ab9a23bd5"
format_stamp: "Formatted at 2026-09-29 06:33:49 on dist-test-slave-601b"
server_key: "4fe17583f3807482364cb1c61bbef7d3"
server_key_iv: "bfa3414cdb0970e8c41b6eeee504396b"
server_key_version: "encryptionkey@0"
I20260929 06:33:49.037215 11260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "f06f5a52733b472b871a049ab9a23bd5"
format_stamp: "Formatted at 2026-09-29 06:33:49 on dist-test-slave-601b"
server_key: "4fe17583f3807482364cb1c61bbef7d3"
server_key_iv: "bfa3414cdb0970e8c41b6eeee504396b"
server_key_version: "encryptionkey@0"
I20260929 06:33:49.038614 11260 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:33:49.039454 11275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:49.039649 11260 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:33:49.039754 11260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "f06f5a52733b472b871a049ab9a23bd5"
format_stamp: "Formatted at 2026-09-29 06:33:49 on dist-test-slave-601b"
server_key: "4fe17583f3807482364cb1c61bbef7d3"
server_key_iv: "bfa3414cdb0970e8c41b6eeee504396b"
server_key_version: "encryptionkey@0"
I20260929 06:33:49.039826 11260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:49.049181 11260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:49.051901 11260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:49.052069 11260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:49.052750 11260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:49.052819 11260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:49.052846 11260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:49.052879 11260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:33:49 dist-test-slave-601b krb5kdc[11143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663629, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:49.060284 11260 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:43811
I20260929 06:33:49.060344 11390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:43811 every 8 connection(s)
I20260929 06:33:49.060712 11260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:33:49.063124 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.053127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:34765 (local address 127.9.61.126:37685)
0929 06:33:49.053167 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.053169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.053386 (+ 217us) server_negotiation.cc:407] Connection header received
0929 06:33:49.053956 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.053958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.053973 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.054050 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:49.054819 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.055606 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.057235 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.057620 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.057707 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.060274 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:49.060276 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:49.060277 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:49.060285 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:49.061733 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.062143 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.062144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.062144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.062207 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.062469 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.062470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.062470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.062587 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:49.062662 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.062940 (+ 278us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.063036 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:33:49.063279 11284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.053123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37685 (local address 127.9.61.65:34765)
0929 06:33:49.053255 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.053288 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.053843 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.054112 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.054115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.054422 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:49.054694 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.054701 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.055744 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.055745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.057134 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.057138 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.057718 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.057719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.057863 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.058411 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:49.058420 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:49.060182 (+ 1762us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:49.061819 (+ 1637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.061825 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.061828 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.062050 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.062272 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.062273 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.062273 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.062386 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.062655 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:49.062661 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:49.062794 (+ 133us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.062915 (+ 121us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.063062 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":76,"threads_started":1}
I20260929 06:33:49.063735 11391 heartbeater.cc:347] Connected to a master server at 127.9.61.126:37685
I20260929 06:33:49.063827 11391 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:49.064114 11391 heartbeater.cc:511] Master 127.9.61.126:37685 requested a full tablet report, sending...
I20260929 06:33:49.064126 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 11260
I20260929 06:33:49.064217 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:33:49.064426 9461 external_mini_cluster.cc:1428] Setting key 65cb5fa9d9aa5ea81c669bec3194ddf9
I20260929 06:33:49.064641 11187 ts_manager.cc:194] Registered new tserver with Master: f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811)
I20260929 06:33:49.065397 11187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:34765
I20260929 06:33:49.071063 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.065592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:33185 (local address 127.9.61.126:37685)
0929 06:33:49.065644 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.065646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.065654 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:33:49.065673 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.065673 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.065683 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.065746 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:49.066107 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.066717 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.067403 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.067607 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.067681 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.068598 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:49.068599 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:49.068599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:49.068606 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:49.069970 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.070321 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.070322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.070323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.070374 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.070575 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.070576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.070576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.070680 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:49.070751 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.070900 (+ 149us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.070974 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 06:33:49.071076 11397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.064820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37685 (local address 127.9.61.65:33185)
0929 06:33:49.064960 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.064972 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.065023 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.065753 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.065754 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.065956 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:49.066022 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.066024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.066812 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.066813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.067302 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.067304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.067679 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.067680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.067751 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.068217 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:49.068222 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:49.068493 (+ 271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:49.070069 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.070070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.070071 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.070237 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.070446 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.070447 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.070448 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.070504 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.070744 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:49.070745 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:49.070789 (+ 44us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.070875 (+ 86us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.070976 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:33:49.087872 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37685
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:49.172712 11400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:49.172981 11400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:49.173010 11400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:49.174238 11400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:49.174278 11400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:49.174299 11400 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260929 06:33:49.174310 11400 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:33:49.174327 11400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:33:49.175729 11400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.61.126:37685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:49.175909 11400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:49.176155 11400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:49.181355 11405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:49.181336 11408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:49.181372 11406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:49.181627 11400 server_base.cc:1034] running on GCE node
I20260929 06:33:49.181826 11400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:49.182091 11400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:49.183260 11400 hybrid_clock.cc:648] HybridClock initialized: now 1790663629183254 us; error 34 us; skew 500 ppm
Sep 29 06:33:49 dist-test-slave-601b krb5kdc[11143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663629, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:49.185804 11400 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:33:49.186219 11400 webserver.cc:460] Webserver started at http://127.9.61.66:45599/ using document root <none> and password file <none>
I20260929 06:33:49.186443 11400 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:49.186511 11400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:49.186661 11400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:49.187674 11400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "4647095c5d204cdfb2a039fa72bf6d95"
format_stamp: "Formatted at 2026-09-29 06:33:49 on dist-test-slave-601b"
server_key: "b08b6ae1310545400d7a6a87668bb257"
server_key_iv: "54744e2a85369561d3a6a2da9f72cf17"
server_key_version: "encryptionkey@0"
I20260929 06:33:49.188100 11400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "4647095c5d204cdfb2a039fa72bf6d95"
format_stamp: "Formatted at 2026-09-29 06:33:49 on dist-test-slave-601b"
server_key: "b08b6ae1310545400d7a6a87668bb257"
server_key_iv: "54744e2a85369561d3a6a2da9f72cf17"
server_key_version: "encryptionkey@0"
I20260929 06:33:49.189368 11400 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:33:49.190058 11415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:49.190215 11400 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:33:49.190310 11400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "4647095c5d204cdfb2a039fa72bf6d95"
format_stamp: "Formatted at 2026-09-29 06:33:49 on dist-test-slave-601b"
server_key: "b08b6ae1310545400d7a6a87668bb257"
server_key_iv: "54744e2a85369561d3a6a2da9f72cf17"
server_key_version: "encryptionkey@0"
I20260929 06:33:49.190402 11400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:49.204646 11400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:49.206979 11400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:49.207166 11400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:49.207666 11400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:49.207731 11400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:49.207775 11400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:49.207806 11400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:49.215148 11400 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:42261
I20260929 06:33:49.215225 11530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:42261 every 8 connection(s)
Sep 29 06:33:49 dist-test-slave-601b krb5kdc[11143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663629, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:49.215579 11400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:33:49.218144 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.208266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:46979 (local address 127.9.61.126:37685)
0929 06:33:49.208314 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.208320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.208530 (+ 210us) server_negotiation.cc:407] Connection header received
0929 06:33:49.209056 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.209058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.209070 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.209124 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:49.210008 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.210852 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.212416 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.212771 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.212992 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.215909 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:49.215910 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:49.215911 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:49.215919 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:49.217059 (+ 1140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.217430 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.217430 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.217431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.217480 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.217639 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.217639 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.217640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.217728 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:49.217773 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.218009 (+ 236us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.218069 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:33:49.218294 11424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.208238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37685 (local address 127.9.61.66:46979)
0929 06:33:49.208406 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.208444 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.208949 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.209196 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.209200 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.209585 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:49.209869 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.209877 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.210979 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.210980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.212315 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.212318 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.213008 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.213009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.213162 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.213909 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:49.213920 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:49.215782 (+ 1862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:49.217135 (+ 1353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.217140 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.217142 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.217352 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.217522 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.217522 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.217522 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.217605 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.217782 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:49.217786 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:49.217897 (+ 111us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.217978 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.218097 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260929 06:33:49.218767 11531 heartbeater.cc:347] Connected to a master server at 127.9.61.126:37685
I20260929 06:33:49.218838 11531 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:49.219048 11531 heartbeater.cc:511] Master 127.9.61.126:37685 requested a full tablet report, sending...
I20260929 06:33:49.219398 11188 ts_manager.cc:194] Registered new tserver with Master: 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66:42261)
I20260929 06:33:49.219851 11188 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:46979
I20260929 06:33:49.222525 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 11400
I20260929 06:33:49.222635 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:33:49.222808 9461 external_mini_cluster.cc:1428] Setting key 9aa140cb1b2f6f6a275040ad4ca1987d
I20260929 06:33:49.225227 11537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.219735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37685 (local address 127.9.61.66:42297)
0929 06:33:49.219883 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.219895 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.219973 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.220099 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.220100 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.220294 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:49.220365 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.220367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.221007 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.221008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.221495 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.221496 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.221796 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.221797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.221850 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.222213 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:49.222216 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:49.222477 (+ 261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:49.224153 (+ 1676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.224154 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.224155 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.224326 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.224559 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.224561 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.224561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.224634 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.224976 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:49.224977 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:49.225017 (+ 40us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.225080 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.225158 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":77,"threads_started":1}
I20260929 06:33:49.225334 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.219872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:42297 (local address 127.9.61.126:37685)
0929 06:33:49.219924 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.219926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.219937 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:33:49.220029 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.220030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.220040 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.220094 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:49.220449 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.220919 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.221563 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.221733 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.221782 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.222574 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:49.222575 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:49.222576 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:49.222583 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:49.224059 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.224420 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.224421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.224421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.224477 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.224698 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.224699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.224699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.224899 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:49.224981 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.225125 (+ 144us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.225219 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:33:49.247149 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37685
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:49.327674 11540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:49.327878 11540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:49.327910 11540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:49.329088 11540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:49.329131 11540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:49.329152 11540 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260929 06:33:49.329206 11540 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:33:49.329237 11540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:33:49.330673 11540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.61.126:37685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:49.330927 11540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:49.331156 11540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:49.336032 11546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:49.336104 11545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:49.336220 11540 server_base.cc:1034] running on GCE node
W20260929 06:33:49.336032 11548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:49.336548 11540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:49.336802 11540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:49.337949 11540 hybrid_clock.cc:648] HybridClock initialized: now 1790663629337930 us; error 33 us; skew 500 ppm
Sep 29 06:33:49 dist-test-slave-601b krb5kdc[11143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663629, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:49.340647 11540 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:33:49.341145 11540 webserver.cc:460] Webserver started at http://127.9.61.67:36401/ using document root <none> and password file <none>
I20260929 06:33:49.341399 11540 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:49.341468 11540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:49.341627 11540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:49.342772 11540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "dc5531fae19b4877bb25d03c4d735ab4"
format_stamp: "Formatted at 2026-09-29 06:33:49 on dist-test-slave-601b"
server_key: "3dd10bc71ec1db2040997fb6dd6fe4c0"
server_key_iv: "e52e3524ce07120af4d78625f116f33a"
server_key_version: "encryptionkey@0"
I20260929 06:33:49.343135 11540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "dc5531fae19b4877bb25d03c4d735ab4"
format_stamp: "Formatted at 2026-09-29 06:33:49 on dist-test-slave-601b"
server_key: "3dd10bc71ec1db2040997fb6dd6fe4c0"
server_key_iv: "e52e3524ce07120af4d78625f116f33a"
server_key_version: "encryptionkey@0"
I20260929 06:33:49.344527 11540 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:33:49.345201 11555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:49.345351 11540 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:49.345451 11540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "dc5531fae19b4877bb25d03c4d735ab4"
format_stamp: "Formatted at 2026-09-29 06:33:49 on dist-test-slave-601b"
server_key: "3dd10bc71ec1db2040997fb6dd6fe4c0"
server_key_iv: "e52e3524ce07120af4d78625f116f33a"
server_key_version: "encryptionkey@0"
I20260929 06:33:49.345525 11540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:49.357856 11540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:49.359583 11540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:49.359745 11540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:49.360330 11540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:49.360395 11540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:49.360428 11540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:49.360448 11540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:33:49 dist-test-slave-601b krb5kdc[11143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663629, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:49.367852 11540 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:42517
I20260929 06:33:49.367985 11670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:42517 every 8 connection(s)
I20260929 06:33:49.368270 11540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:33:49.370314 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.360713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:56883 (local address 127.9.61.126:37685)
0929 06:33:49.360772 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.360774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.361016 (+ 242us) server_negotiation.cc:407] Connection header received
0929 06:33:49.361756 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.361757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.361772 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.361869 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:49.362777 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.363299 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.365043 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.365245 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.365330 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.367463 (+ 2133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:49.367464 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:49.367465 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:49.367472 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:49.369195 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.369538 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.369539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.369539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.369589 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.369804 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.369804 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.369805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.369900 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:49.369945 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.370179 (+ 234us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.370254 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:33:49.370538 11564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.360682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37685 (local address 127.9.61.67:56883)
0929 06:33:49.360850 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.360914 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.361631 (+ 717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.361971 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.361976 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.362372 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:49.362670 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.362676 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.363385 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.363386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.364922 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.364925 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.365348 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.365350 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.365516 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.366051 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:49.366059 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:49.367371 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:49.369263 (+ 1892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.369267 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.369269 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.369485 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.369645 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.369646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.369646 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.369757 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.369952 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:49.369956 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:49.370061 (+ 105us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.370149 (+ 88us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.370292 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":89,"threads_started":1}
I20260929 06:33:49.370987 11671 heartbeater.cc:347] Connected to a master server at 127.9.61.126:37685
I20260929 06:33:49.371080 11671 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:49.371249 11671 heartbeater.cc:511] Master 127.9.61.126:37685 requested a full tablet report, sending...
I20260929 06:33:49.371637 11187 ts_manager.cc:194] Registered new tserver with Master: dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67:42517)
I20260929 06:33:49.371701 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 11540
I20260929 06:33:49.371778 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:33:49.372032 9461 external_mini_cluster.cc:1428] Setting key 17fb21ed34ebf10a6ab3559cf745ceea
I20260929 06:33:49.372155 11187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:56883
I20260929 06:33:49.373373 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:33:49.378100 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.372046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:36479 (local address 127.9.61.126:37685)
0929 06:33:49.372322 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.372324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.372332 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:33:49.372350 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.372351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.372359 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.372403 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:49.372756 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.373320 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.374056 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.374264 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.374362 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.375251 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:49.375252 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:49.375253 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:49.375260 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:49.376992 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.377298 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.377299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.377300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.377361 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.377589 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.377590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.377590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.377699 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:49.377772 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.377946 (+ 174us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.378013 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253}
I20260929 06:33:49.378118 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.372092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37685 (local address 127.9.61.67:36479)
0929 06:33:49.372226 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.372238 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.372289 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.372418 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.372419 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.372625 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:49.372677 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.372679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.373442 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.373443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.373963 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.373964 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.374364 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.374365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.374443 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.374877 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:49.374881 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:49.375164 (+ 283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:49.377067 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.377068 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.377068 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.377226 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.377444 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.377444 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.377445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.377506 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.377764 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:49.377765 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:49.377825 (+ 60us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.377914 (+ 89us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.378015 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
Sep 29 06:33:49 dist-test-slave-601b krb5kdc[11143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 06:33:49 dist-test-slave-601b krb5kdc[11143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:49.397027 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.389946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34518 (local address 127.9.61.126:37685)
0929 06:33:49.390007 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.390009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.390037 (+ 28us) server_negotiation.cc:407] Connection header received
0929 06:33:49.390058 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.390058 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.390067 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.390108 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:49.390638 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.391136 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.391828 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.392069 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.392120 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.394367 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:49.394368 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:49.394369 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:49.394374 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:49.395917 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.396270 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.396271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.396271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.396321 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.396471 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.396472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.396472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.396568 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:49.396693 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.396828 (+ 135us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.396904 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 06:33:49.398732 11187 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34518:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:33:49.400276 11187 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:33:49.406404 11685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.402316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43811 (local address 127.0.0.1:38652)
0929 06:33:49.402469 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.402509 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.402571 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.402847 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.402849 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.402851 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:49.402923 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.402924 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.404258 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.404259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.405401 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.405404 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.406104 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.406105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.406181 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.406195 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.406266 (+ 71us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.406319 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":4,"thread_start_us":54,"threads_started":1}
I20260929 06:33:49.406421 11688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.402497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38652 (local address 127.9.61.65:43811)
0929 06:33:49.402662 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.402667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.402678 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:33:49.402719 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.402722 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.402739 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.402838 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:49.402992 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.404176 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.405505 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.406000 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.406101 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.406163 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.406288 (+ 125us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.406325 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260929 06:33:49.406654 11687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.402335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:42517 (local address 127.0.0.1:57514)
0929 06:33:49.403087 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.403098 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.403147 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.403386 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.403387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.403388 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:49.403435 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.403437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.404579 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.404580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.405453 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.405455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.406395 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.406396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.406467 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.406470 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.406523 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.406556 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"mutex_wait_us":2,"thread_start_us":48,"threads_started":1}
I20260929 06:33:49.406703 11689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.402563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57514 (local address 127.9.61.67:42517)
0929 06:33:49.402760 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.402765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.403202 (+ 437us) server_negotiation.cc:407] Connection header received
0929 06:33:49.403245 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.403247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.403263 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.403327 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:49.403508 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.404489 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.405559 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.406235 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.406304 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.406357 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.406543 (+ 186us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.406595 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":93,"threads_started":1}
I20260929 06:33:49.406654 11686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.402316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:42261 (local address 127.0.0.1:58114)
0929 06:33:49.402663 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.402672 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.402708 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.403018 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.403018 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.403020 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:49.403064 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.403066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.404064 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.404065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.405437 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.405439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.406396 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.406397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.406462 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.406465 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.406519 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.406556 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":42,"thread_start_us":50,"threads_started":1}
I20260929 06:33:49.406847 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.402676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58114 (local address 127.9.61.66:42261)
0929 06:33:49.402853 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.402857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.402866 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:33:49.402902 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.402904 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.402918 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.403009 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:49.403153 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.403917 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.405511 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.406235 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.406304 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.406357 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.406693 (+ 336us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.406742 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":81,"threads_started":1}
I20260929 06:33:49.407480 11605 tablet_service.cc:1467] Processing CreateTablet for tablet 575c0e8a15cd4f6eb00ccdef470dc21b (DEFAULT_TABLE table=test-table [id=40854d74d9e344d4932f866bc452cf57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:49.407482 11461 tablet_service.cc:1467] Processing CreateTablet for tablet 575c0e8a15cd4f6eb00ccdef470dc21b (DEFAULT_TABLE table=test-table [id=40854d74d9e344d4932f866bc452cf57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:49.407840 11605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 575c0e8a15cd4f6eb00ccdef470dc21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:49.407840 11461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 575c0e8a15cd4f6eb00ccdef470dc21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:49.408490 11325 tablet_service.cc:1467] Processing CreateTablet for tablet 575c0e8a15cd4f6eb00ccdef470dc21b (DEFAULT_TABLE table=test-table [id=40854d74d9e344d4932f866bc452cf57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:49.408794 11325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 575c0e8a15cd4f6eb00ccdef470dc21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:49.411167 11691 tablet_bootstrap.cc:492] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4: Bootstrap starting.
I20260929 06:33:49.411681 11692 tablet_bootstrap.cc:492] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5: Bootstrap starting.
I20260929 06:33:49.412101 11693 tablet_bootstrap.cc:492] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95: Bootstrap starting.
I20260929 06:33:49.412235 11691 tablet_bootstrap.cc:654] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:49.412302 11692 tablet_bootstrap.cc:654] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:49.412612 11691 log.cc:824] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:49.412626 11692 log.cc:824] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:49.412694 11693 tablet_bootstrap.cc:654] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:49.413028 11693 log.cc:824] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:49.413456 11691 tablet_bootstrap.cc:492] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4: No bootstrap required, opened a new log
I20260929 06:33:49.413527 11691 ts_tablet_manager.cc:1397] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:33:49.413580 11692 tablet_bootstrap.cc:492] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5: No bootstrap required, opened a new log
I20260929 06:33:49.413651 11692 ts_tablet_manager.cc:1397] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:33:49.413759 11693 tablet_bootstrap.cc:492] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95: No bootstrap required, opened a new log
I20260929 06:33:49.413817 11693 ts_tablet_manager.cc:1397] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:33:49.415225 11691 raft_consensus.cc:348] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.415373 11691 raft_consensus.cc:374] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:49.415423 11691 raft_consensus.cc:729] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc5531fae19b4877bb25d03c4d735ab4, State: Initialized, Role: FOLLOWER
I20260929 06:33:49.415536 11691 consensus_queue.cc:260] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.415628 11692 raft_consensus.cc:348] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.415798 11692 raft_consensus.cc:374] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:49.415719 11693 raft_consensus.cc:348] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.415818 11691 ts_tablet_manager.cc:1428] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:33:49.415841 11693 raft_consensus.cc:374] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:49.415839 11692 raft_consensus.cc:729] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f06f5a52733b472b871a049ab9a23bd5, State: Initialized, Role: FOLLOWER
I20260929 06:33:49.415877 11693 raft_consensus.cc:729] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4647095c5d204cdfb2a039fa72bf6d95, State: Initialized, Role: FOLLOWER
I20260929 06:33:49.415982 11671 heartbeater.cc:503] Master 127.9.61.126:37685 was elected leader, sending a full tablet report...
I20260929 06:33:49.416002 11692 consensus_queue.cc:260] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.415994 11693 consensus_queue.cc:260] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.416257 11692 ts_tablet_manager.cc:1428] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:33:49.416257 11693 ts_tablet_manager.cc:1428] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260929 06:33:49.416369 11391 heartbeater.cc:503] Master 127.9.61.126:37685 was elected leader, sending a full tablet report...
I20260929 06:33:49.416390 11531 heartbeater.cc:503] Master 127.9.61.126:37685 was elected leader, sending a full tablet report...
W20260929 06:33:49.466115 11532 tablet.cc:2369] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:33:49.479563 11698 raft_consensus.cc:482] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:33:49.479717 11698 raft_consensus.cc:504] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.480142 11698 leader_election.cc:288] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66:42261), dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67:42517)
I20260929 06:33:49.482996 11284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.480316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:42261 (local address 127.9.61.65:52781)
0929 06:33:49.480359 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.480373 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.480442 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.480625 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.480626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.480628 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:49.480704 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.480707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.481374 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.481375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.482196 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.482198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.482725 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.482726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.482800 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.482803 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.482870 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.482918 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":39}
I20260929 06:33:49.482992 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.480389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:52781 (local address 127.9.61.66:42261)
0929 06:33:49.480433 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.480435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.480445 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:33:49.480535 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.480536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.480550 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.480609 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:49.480784 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.481294 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.482293 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.482646 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.482699 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.482707 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.482879 (+ 172us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.482923 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:33:49.483052 11689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.480456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:59349 (local address 127.9.61.67:42517)
0929 06:33:49.480498 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.480500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.480630 (+ 130us) server_negotiation.cc:407] Connection header received
0929 06:33:49.480656 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.480657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.480669 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.480722 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:49.480923 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.481386 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.482295 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.482665 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.482753 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.482761 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.482943 (+ 182us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.482979 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:33:49.483284 11700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.480333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:42517 (local address 127.9.61.65:59349)
0929 06:33:49.480519 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.480528 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.480592 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.480756 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.480756 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.480758 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:49.480834 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.480836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.481466 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.481467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.482199 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.482201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.482781 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.482782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.482862 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.482866 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.482923 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.482965 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":3,"thread_start_us":129,"threads_started":1}
I20260929 06:33:49.483415 11485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575c0e8a15cd4f6eb00ccdef470dc21b" candidate_uuid: "f06f5a52733b472b871a049ab9a23bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4647095c5d204cdfb2a039fa72bf6d95" is_pre_election: true
I20260929 06:33:49.483583 11485 raft_consensus.cc:2454] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f06f5a52733b472b871a049ab9a23bd5 in term 0.
I20260929 06:33:49.483721 11625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575c0e8a15cd4f6eb00ccdef470dc21b" candidate_uuid: "f06f5a52733b472b871a049ab9a23bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc5531fae19b4877bb25d03c4d735ab4" is_pre_election: true
I20260929 06:33:49.483843 11276 leader_election.cc:302] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4647095c5d204cdfb2a039fa72bf6d95, f06f5a52733b472b871a049ab9a23bd5; no voters:
I20260929 06:33:49.483875 11625 raft_consensus.cc:2454] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f06f5a52733b472b871a049ab9a23bd5 in term 0.
I20260929 06:33:49.483994 11698 raft_consensus.cc:2781] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:33:49.484082 11698 raft_consensus.cc:482] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:33:49.484119 11698 raft_consensus.cc:3037] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:49.484820 11698 raft_consensus.cc:504] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.484972 11698 leader_election.cc:288] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [CANDIDATE]: Term 1 election: Requested vote from peers 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66:42261), dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67:42517)
I20260929 06:33:49.485118 11485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575c0e8a15cd4f6eb00ccdef470dc21b" candidate_uuid: "f06f5a52733b472b871a049ab9a23bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4647095c5d204cdfb2a039fa72bf6d95"
I20260929 06:33:49.485183 11625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575c0e8a15cd4f6eb00ccdef470dc21b" candidate_uuid: "f06f5a52733b472b871a049ab9a23bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc5531fae19b4877bb25d03c4d735ab4"
I20260929 06:33:49.485203 11485 raft_consensus.cc:3037] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:49.485265 11625 raft_consensus.cc:3037] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:49.485867 11485 raft_consensus.cc:2454] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f06f5a52733b472b871a049ab9a23bd5 in term 1.
I20260929 06:33:49.486022 11625 raft_consensus.cc:2454] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f06f5a52733b472b871a049ab9a23bd5 in term 1.
I20260929 06:33:49.486099 11276 leader_election.cc:302] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4647095c5d204cdfb2a039fa72bf6d95, f06f5a52733b472b871a049ab9a23bd5; no voters:
I20260929 06:33:49.486199 11698 raft_consensus.cc:2781] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:49.486373 11698 raft_consensus.cc:686] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 1 LEADER]: Becoming Leader. State: Replica: f06f5a52733b472b871a049ab9a23bd5, State: Running, Role: LEADER
I20260929 06:33:49.486477 11698 consensus_queue.cc:237] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.487313 11187 catalog_manager.cc:5495] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65). New cstate: current_term: 1 leader_uuid: "f06f5a52733b472b871a049ab9a23bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } health_report { overall_health: UNKNOWN } } }
Sep 29 06:33:49 dist-test-slave-601b krb5kdc[11143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663628, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:49.523064 11708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.516682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37685 (local address 127.0.0.1:34534)
0929 06:33:49.516860 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.516868 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.516976 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.517121 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.517121 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.517436 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:49.517483 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.517485 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.518130 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.518131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.518643 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.518645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.519005 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.519005 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.519055 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.519531 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:49.519536 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:49.520869 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:49.522172 (+ 1303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.522178 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.522181 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.522365 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.522531 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:49.522531 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:49.522531 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:49.522584 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:49.522776 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:49.522781 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:49.522822 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.522873 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.522972 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":84,"threads_started":1}
I20260929 06:33:49.523130 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.516745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34534 (local address 127.9.61.126:37685)
0929 06:33:49.516818 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.516821 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.516956 (+ 135us) server_negotiation.cc:407] Connection header received
0929 06:33:49.517046 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.517047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.517057 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.517104 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:49.517565 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.518046 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.518723 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.518924 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.519005 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.520949 (+ 1944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:49.520950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:49.520950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:49.520957 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:49.522102 (+ 1145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.522426 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.522427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.522427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.522474 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:49.522633 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:49.522633 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:49.522634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:49.522725 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:49.522771 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.522912 (+ 141us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.523018 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":40}
I20260929 06:33:49.525012 11187 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:34534:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260929 06:33:49.525226 11187 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:33:49.526731 11461 tablet_service.cc:1467] Processing CreateTablet for tablet 95bd3b3886d54f85948e99032cac063a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c45b5cd067664d538ecc793e6d533249]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:33:49.526829 11605 tablet_service.cc:1467] Processing CreateTablet for tablet 95bd3b3886d54f85948e99032cac063a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c45b5cd067664d538ecc793e6d533249]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:33:49.526919 11461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95bd3b3886d54f85948e99032cac063a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:49.526880 11325 tablet_service.cc:1467] Processing CreateTablet for tablet 95bd3b3886d54f85948e99032cac063a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c45b5cd067664d538ecc793e6d533249]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:33:49.527009 11605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95bd3b3886d54f85948e99032cac063a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:49.527040 11325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95bd3b3886d54f85948e99032cac063a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:49.528236 11691 tablet_bootstrap.cc:492] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: Bootstrap starting.
I20260929 06:33:49.528473 11692 tablet_bootstrap.cc:492] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5: Bootstrap starting.
I20260929 06:33:49.528473 11693 tablet_bootstrap.cc:492] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95: Bootstrap starting.
I20260929 06:33:49.528805 11691 tablet_bootstrap.cc:654] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:49.528941 11692 tablet_bootstrap.cc:654] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:49.529170 11693 tablet_bootstrap.cc:654] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:49.529404 11691 tablet_bootstrap.cc:492] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: No bootstrap required, opened a new log
I20260929 06:33:49.529469 11691 ts_tablet_manager.cc:1397] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:49.529620 11691 raft_consensus.cc:348] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.529708 11691 raft_consensus.cc:374] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:49.529735 11691 raft_consensus.cc:729] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc5531fae19b4877bb25d03c4d735ab4, State: Initialized, Role: FOLLOWER
I20260929 06:33:49.529784 11691 consensus_queue.cc:260] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.529836 11693 tablet_bootstrap.cc:492] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95: No bootstrap required, opened a new log
I20260929 06:33:49.529893 11691 ts_tablet_manager.cc:1428] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:49.529894 11693 ts_tablet_manager.cc:1397] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:33:49.529891 11692 tablet_bootstrap.cc:492] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5: No bootstrap required, opened a new log
I20260929 06:33:49.529942 11692 ts_tablet_manager.cc:1397] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:33:49.530042 11693 raft_consensus.cc:348] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.530042 11697 tablet_replica.cc:439] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } } }
I20260929 06:33:49.530113 11693 raft_consensus.cc:374] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:49.530117 11697 tablet_replica.cc:442] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:49.530138 11693 raft_consensus.cc:729] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4647095c5d204cdfb2a039fa72bf6d95, State: Initialized, Role: FOLLOWER
I20260929 06:33:49.530084 11692 raft_consensus.cc:348] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.530185 11692 raft_consensus.cc:374] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:49.530177 11693 consensus_queue.cc:260] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.530206 11692 raft_consensus.cc:729] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f06f5a52733b472b871a049ab9a23bd5, State: Initialized, Role: FOLLOWER
I20260929 06:33:49.530251 11692 consensus_queue.cc:260] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.530253 11693 ts_tablet_manager.cc:1428] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:49.530341 11692 ts_tablet_manager.cc:1428] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:49.530347 11699 tablet_replica.cc:439] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } } }
I20260929 06:33:49.530452 11699 tablet_replica.cc:442] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:49.530683 11698 tablet_replica.cc:439] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } } }
I20260929 06:33:49.530772 11698 tablet_replica.cc:442] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:49.539235 11697 raft_consensus.cc:482] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:33:49.539328 11697 raft_consensus.cc:504] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.539646 11697 leader_election.cc:288] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811), 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66:42261)
I20260929 06:33:49.542532 11688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.539907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:60775 (local address 127.9.61.65:43811)
0929 06:33:49.539987 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.539989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.539998 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:33:49.540019 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.540019 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.540028 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.540084 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:49.540235 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.540731 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.541753 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.542164 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.542250 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.542259 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.542415 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.542453 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260929 06:33:49.542527 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.539958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:41843 (local address 127.9.61.66:42261)
0929 06:33:49.539998 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.540000 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.540050 (+ 50us) server_negotiation.cc:407] Connection header received
0929 06:33:49.540105 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.540106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.540114 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.540166 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:49.540309 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.540775 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.541779 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.542132 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.542222 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.542233 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.542407 (+ 174us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.542441 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:33:49.542544 11564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.539798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43811 (local address 127.9.61.67:60775)
0929 06:33:49.539849 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.539860 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.539899 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.540098 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.540099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.540100 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:49.540159 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.540161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.540838 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.540839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.541668 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.541670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.542252 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.542253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.542332 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.542334 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.542406 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.542450 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 06:33:49.542630 11712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.539841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:42261 (local address 127.9.61.67:41843)
0929 06:33:49.540007 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.540015 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.540059 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.540170 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.540170 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.540172 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:49.540233 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.540234 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.540978 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.540979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.541692 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.541694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.542239 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.542241 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.542317 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.542321 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.542399 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.542436 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":1,"thread_start_us":73,"threads_started":1}
I20260929 06:33:49.542855 11345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95bd3b3886d54f85948e99032cac063a" candidate_uuid: "dc5531fae19b4877bb25d03c4d735ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f06f5a52733b472b871a049ab9a23bd5" is_pre_election: true
I20260929 06:33:49.542852 11485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95bd3b3886d54f85948e99032cac063a" candidate_uuid: "dc5531fae19b4877bb25d03c4d735ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4647095c5d204cdfb2a039fa72bf6d95" is_pre_election: true
I20260929 06:33:49.542950 11485 raft_consensus.cc:2454] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc5531fae19b4877bb25d03c4d735ab4 in term 0.
I20260929 06:33:49.542969 11345 raft_consensus.cc:2454] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc5531fae19b4877bb25d03c4d735ab4 in term 0.
I20260929 06:33:49.543146 11559 leader_election.cc:302] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc5531fae19b4877bb25d03c4d735ab4, f06f5a52733b472b871a049ab9a23bd5; no voters:
I20260929 06:33:49.543264 11697 raft_consensus.cc:2781] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:33:49.543318 11697 raft_consensus.cc:482] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:33:49.543351 11697 raft_consensus.cc:3037] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:49.544117 11697 raft_consensus.cc:504] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.544245 11697 leader_election.cc:288] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [CANDIDATE]: Term 1 election: Requested vote from peers f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811), 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66:42261)
I20260929 06:33:49.544349 11345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95bd3b3886d54f85948e99032cac063a" candidate_uuid: "dc5531fae19b4877bb25d03c4d735ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f06f5a52733b472b871a049ab9a23bd5"
I20260929 06:33:49.544415 11345 raft_consensus.cc:3037] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:49.544418 11485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95bd3b3886d54f85948e99032cac063a" candidate_uuid: "dc5531fae19b4877bb25d03c4d735ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4647095c5d204cdfb2a039fa72bf6d95"
I20260929 06:33:49.544476 11485 raft_consensus.cc:3037] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:49.545159 11485 raft_consensus.cc:2454] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc5531fae19b4877bb25d03c4d735ab4 in term 1.
I20260929 06:33:49.545214 11345 raft_consensus.cc:2454] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc5531fae19b4877bb25d03c4d735ab4 in term 1.
I20260929 06:33:49.545328 11556 leader_election.cc:302] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4647095c5d204cdfb2a039fa72bf6d95, dc5531fae19b4877bb25d03c4d735ab4; no voters:
I20260929 06:33:49.545420 11697 raft_consensus.cc:2781] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:49.545562 11697 raft_consensus.cc:686] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [term 1 LEADER]: Becoming Leader. State: Replica: dc5531fae19b4877bb25d03c4d735ab4, State: Running, Role: LEADER
I20260929 06:33:49.545655 11697 consensus_queue.cc:237] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.546129 11713 tablet_replica.cc:439] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: TxnStatusTablet state changed. Reason: New leader dc5531fae19b4877bb25d03c4d735ab4. Latest consensus state: current_term: 1 leader_uuid: "dc5531fae19b4877bb25d03c4d735ab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } } }
I20260929 06:33:49.546216 11713 tablet_replica.cc:442] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:33:49.546401 11715 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260929 06:33:49.546383 11188 catalog_manager.cc:5495] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67). New cstate: current_term: 1 leader_uuid: "dc5531fae19b4877bb25d03c4d735ab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } health_report { overall_health: HEALTHY } } }
I20260929 06:33:49.546509 11715 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260929 06:33:49.553260 11689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.550636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57526 (local address 127.9.61.67:42517)
0929 06:33:49.550673 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.550675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.550716 (+ 41us) server_negotiation.cc:407] Connection header received
0929 06:33:49.550806 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.550806 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.550819 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.550875 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:49.551031 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.551451 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.552583 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.552751 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.552803 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.552997 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:49.553075 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:49.553130 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.553201 (+ 71us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.553216 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:33:49.553321 11708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.550595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:42517 (local address 127.0.0.1:57526)
0929 06:33:49.550672 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.550683 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.550733 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.550905 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.550906 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.550907 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:33:49.550960 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.550963 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.551526 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.551527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.552507 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.552510 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.552824 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.552825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.552893 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.552909 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:33:49.553136 (+ 227us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:33:49.553144 (+ 8us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.553199 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.553245 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260929 06:33:49.554960 11485 raft_consensus.cc:1261] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Refusing update from remote peer dc5531fae19b4877bb25d03c4d735ab4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:49.555014 11345 raft_consensus.cc:1261] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Refusing update from remote peer dc5531fae19b4877bb25d03c4d735ab4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:49.555261 11713 consensus_queue.cc:1035] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:49.555388 11697 consensus_queue.cc:1035] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:49.556569 11698 tablet_replica.cc:439] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5: TxnStatusTablet state changed. Reason: New leader dc5531fae19b4877bb25d03c4d735ab4. Latest consensus state: current_term: 1 leader_uuid: "dc5531fae19b4877bb25d03c4d735ab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } } }
I20260929 06:33:49.556655 11698 tablet_replica.cc:442] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:49.556877 11699 tablet_replica.cc:439] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95: TxnStatusTablet state changed. Reason: New leader dc5531fae19b4877bb25d03c4d735ab4. Latest consensus state: current_term: 1 leader_uuid: "dc5531fae19b4877bb25d03c4d735ab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } } }
I20260929 06:33:49.556969 11699 tablet_replica.cc:442] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:49.557799 11697 tablet_replica.cc:439] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc5531fae19b4877bb25d03c4d735ab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } } }
I20260929 06:33:49.557886 11697 tablet_replica.cc:442] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:33:49.557955 11718 mvcc.cc:205] Tried to move back new op lower bound from 7334558226654990336 to 7334558226619662336. Current Snapshot: MvccSnapshot[applied={T|T < 7334558226654990336}]
I20260929 06:33:49.557996 11699 tablet_replica.cc:439] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc5531fae19b4877bb25d03c4d735ab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } } }
I20260929 06:33:49.558063 11699 tablet_replica.cc:442] T 95bd3b3886d54f85948e99032cac063a P 4647095c5d204cdfb2a039fa72bf6d95: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:33:49.558115 11721 mvcc.cc:205] Tried to move back new op lower bound from 7334558226654990336 to 7334558226619662336. Current Snapshot: MvccSnapshot[applied={T|T < 7334558226654990336}]
I20260929 06:33:49.558542 11697 tablet_replica.cc:439] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc5531fae19b4877bb25d03c4d735ab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } } }
I20260929 06:33:49.558629 11697 tablet_replica.cc:442] T 95bd3b3886d54f85948e99032cac063a P dc5531fae19b4877bb25d03c4d735ab4: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:33:49.559041 11698 tablet_replica.cc:439] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc5531fae19b4877bb25d03c4d735ab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } } }
I20260929 06:33:49.559123 11698 tablet_replica.cc:442] T 95bd3b3886d54f85948e99032cac063a P f06f5a52733b472b871a049ab9a23bd5: This TxnStatusTablet replica's current role is: FOLLOWER
W20260929 06:33:49.561496 11392 tablet.cc:2369] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:33:49.563202 11688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.560647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38668 (local address 127.9.61.65:43811)
0929 06:33:49.560686 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.560688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.560696 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:33:49.560752 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.560753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.560769 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.560848 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:49.560945 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.561672 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.562416 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.562716 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.562785 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.562904 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:49.563019 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:49.563092 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.563115 (+ 23us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.563135 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:33:49.567905 11689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.565548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:38087 (local address 127.9.61.67:42517)
0929 06:33:49.565587 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.565589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.565596 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:33:49.565662 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.565662 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.565670 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.565709 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:49.565830 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.566251 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.567315 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.567484 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.567532 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.567722 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:49.567744 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:49.567780 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.567834 (+ 54us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.567847 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:33:49.567968 11397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.565474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:42517 (local address 127.9.61.65:38087)
0929 06:33:49.565552 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.565564 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.565609 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.565720 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.565721 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.565722 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:33:49.565775 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.565776 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.566319 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.566320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.567233 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.567236 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.567553 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.567554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.567617 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.567631 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:33:49.567781 (+ 150us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:33:49.567782 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.567830 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.567867 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260929 06:33:49.570255 11485 raft_consensus.cc:1261] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Refusing update from remote peer f06f5a52733b472b871a049ab9a23bd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:49.570251 11625 raft_consensus.cc:1261] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Refusing update from remote peer f06f5a52733b472b871a049ab9a23bd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:49.570523 11701 consensus_queue.cc:1035] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:49.570658 11698 consensus_queue.cc:1035] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:49.572263 11719 mvcc.cc:205] Tried to move back new op lower bound from 7334558226718105600 to 7334558226377371648. Current Snapshot: MvccSnapshot[applied={T|T < 7334558226718105600}]
I20260929 06:33:49.579309 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.576435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43811 (local address 127.9.61.67:40335)
0929 06:33:49.576490 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.576501 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.576547 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.576676 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.576676 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.576678 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:33:49.576721 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.576722 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.577560 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.577561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.578544 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.578546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.578994 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.578995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.579039 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.579050 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:33:49.579200 (+ 150us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:33:49.579201 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.579235 (+ 34us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.579264 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260929 06:33:49.579320 11688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.576506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:40335 (local address 127.9.61.65:43811)
0929 06:33:49.576541 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.576543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.576550 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:33:49.576608 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.576608 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.576619 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.576669 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:49.576785 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.577492 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.578619 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.578914 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.578982 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.579115 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:49.579145 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:49.579196 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.579238 (+ 42us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.579256 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:33:49.587719 11188 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:33:49.587821 11188 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:33:49.588616 11188 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e: Sending DeleteTablet for 3 replicas of tablet 575c0e8a15cd4f6eb00ccdef470dc21b
I20260929 06:33:49.588896 11325 tablet_service.cc:1514] Processing DeleteTablet for tablet 575c0e8a15cd4f6eb00ccdef470dc21b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:49 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:38652
I20260929 06:33:49.589098 11736 tablet_replica.cc:330] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5: stopping tablet replica
I20260929 06:33:49.589181 11736 raft_consensus.cc:2229] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:33:49.589267 11736 raft_consensus.cc:2258] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:49.589478 11605 tablet_service.cc:1514] Processing DeleteTablet for tablet 575c0e8a15cd4f6eb00ccdef470dc21b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:49 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:57514
I20260929 06:33:49.589654 11736 ts_tablet_manager.cc:1905] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:49.589820 11461 tablet_service.cc:1514] Processing DeleteTablet for tablet 575c0e8a15cd4f6eb00ccdef470dc21b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:49 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:58114
I20260929 06:33:49.589825 11188 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34518:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:33:49.589973 11188 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:33:49.591264 11325 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2988705fcb4e83a82e95ac05db24ed (DEFAULT_TABLE table=test-table [id=b1feb6d9ed5d4237a9633b14a619e9e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:49.591410 11325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2988705fcb4e83a82e95ac05db24ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:49.591852 11605 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2988705fcb4e83a82e95ac05db24ed (DEFAULT_TABLE table=test-table [id=b1feb6d9ed5d4237a9633b14a619e9e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:49.591979 11605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2988705fcb4e83a82e95ac05db24ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:49.592628 11692 tablet_bootstrap.cc:492] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5: Bootstrap starting.
I20260929 06:33:49.593011 11692 tablet_bootstrap.cc:654] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:49.591398 11736 ts_tablet_manager.cc:1918] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:33:49.593422 11736 log.cc:1196] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/wal/wals/575c0e8a15cd4f6eb00ccdef470dc21b
I20260929 06:33:49.593734 11736 ts_tablet_manager.cc:1939] T 575c0e8a15cd4f6eb00ccdef470dc21b P f06f5a52733b472b871a049ab9a23bd5: Deleting consensus metadata
I20260929 06:33:49.593776 11691 tablet_bootstrap.cc:492] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4: Bootstrap starting.
I20260929 06:33:49.594048 11737 tablet_replica.cc:330] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4: stopping tablet replica
I20260929 06:33:49.594084 11175 catalog_manager.cc:4841] TS f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811): tablet 575c0e8a15cd4f6eb00ccdef470dc21b (table test-table [id=40854d74d9e344d4932f866bc452cf57]) successfully deleted
I20260929 06:33:49.594146 11737 raft_consensus.cc:2229] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:33:49.594187 11691 tablet_bootstrap.cc:654] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:49.594199 11737 raft_consensus.cc:2258] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:49.594470 11692 tablet_bootstrap.cc:492] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5: No bootstrap required, opened a new log
I20260929 06:33:49.594509 11692 ts_tablet_manager.cc:1397] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:33:49.594674 11737 ts_tablet_manager.cc:1905] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:49.594667 11692 raft_consensus.cc:348] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.594735 11692 raft_consensus.cc:374] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:49.594754 11692 raft_consensus.cc:729] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f06f5a52733b472b871a049ab9a23bd5, State: Initialized, Role: FOLLOWER
I20260929 06:33:49.594794 11692 consensus_queue.cc:260] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.594901 11692 ts_tablet_manager.cc:1428] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:49.595046 11461 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2988705fcb4e83a82e95ac05db24ed (DEFAULT_TABLE table=test-table [id=b1feb6d9ed5d4237a9633b14a619e9e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:49.595175 11461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2988705fcb4e83a82e95ac05db24ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:49.595700 11691 tablet_bootstrap.cc:492] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4: No bootstrap required, opened a new log
I20260929 06:33:49.595757 11691 ts_tablet_manager.cc:1397] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:33:49.595878 11691 raft_consensus.cc:348] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.595966 11691 raft_consensus.cc:374] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:49.595988 11691 raft_consensus.cc:729] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc5531fae19b4877bb25d03c4d735ab4, State: Initialized, Role: FOLLOWER
I20260929 06:33:49.596032 11691 consensus_queue.cc:260] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.596110 11691 ts_tablet_manager.cc:1428] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:49.596730 11693 tablet_bootstrap.cc:492] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95: Bootstrap starting.
I20260929 06:33:49.597097 11693 tablet_bootstrap.cc:654] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:49.597745 11693 tablet_bootstrap.cc:492] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95: No bootstrap required, opened a new log
I20260929 06:33:49.597785 11693 ts_tablet_manager.cc:1397] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:33:49.597914 11693 raft_consensus.cc:348] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.597995 11693 raft_consensus.cc:374] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:49.598017 11693 raft_consensus.cc:729] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4647095c5d204cdfb2a039fa72bf6d95, State: Initialized, Role: FOLLOWER
I20260929 06:33:49.598047 11693 consensus_queue.cc:260] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.598127 11693 ts_tablet_manager.cc:1428] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:49.598515 11737 ts_tablet_manager.cc:1918] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:33:49.598600 11737 log.cc:1196] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/575c0e8a15cd4f6eb00ccdef470dc21b
I20260929 06:33:49.598826 11737 ts_tablet_manager.cc:1939] T 575c0e8a15cd4f6eb00ccdef470dc21b P dc5531fae19b4877bb25d03c4d735ab4: Deleting consensus metadata
I20260929 06:33:49.599210 11738 tablet_replica.cc:330] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95: stopping tablet replica
I20260929 06:33:49.599251 11174 catalog_manager.cc:4841] TS dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67:42517): tablet 575c0e8a15cd4f6eb00ccdef470dc21b (table test-table [id=40854d74d9e344d4932f866bc452cf57]) successfully deleted
I20260929 06:33:49.599334 11738 raft_consensus.cc:2229] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:33:49.599390 11738 raft_consensus.cc:2258] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:49.600291 11738 ts_tablet_manager.cc:1905] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:49.601739 11738 ts_tablet_manager.cc:1918] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:33:49.601811 11738 log.cc:1196] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/575c0e8a15cd4f6eb00ccdef470dc21b
I20260929 06:33:49.602056 11738 ts_tablet_manager.cc:1939] T 575c0e8a15cd4f6eb00ccdef470dc21b P 4647095c5d204cdfb2a039fa72bf6d95: Deleting consensus metadata
I20260929 06:33:49.602520 11172 catalog_manager.cc:4841] TS 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66:42261): tablet 575c0e8a15cd4f6eb00ccdef470dc21b (table test-table [id=40854d74d9e344d4932f866bc452cf57]) successfully deleted
W20260929 06:33:49.619519 11672 tablet.cc:2369] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:33:49.836223 11699 raft_consensus.cc:482] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:33:49.836318 11699 raft_consensus.cc:504] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.836715 11699 leader_election.cc:288] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811), dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67:42517)
I20260929 06:33:49.839684 11743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.836888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43811 (local address 127.9.61.66:48871)
0929 06:33:49.837047 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.837058 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.837149 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.837328 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.837329 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.837331 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:49.837400 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.837402 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.838028 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.838029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.838849 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.838851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.839405 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.839406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.839483 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.839488 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.839541 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.839573 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":32,"thread_start_us":101,"threads_started":1}
I20260929 06:33:49.839702 11688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.836969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:48871 (local address 127.9.61.65:43811)
0929 06:33:49.837059 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.837062 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.837114 (+ 52us) server_negotiation.cc:407] Connection header received
0929 06:33:49.837222 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.837223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.837232 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.837311 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:49.837472 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.837944 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.838953 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.839328 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.839384 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.839393 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.839569 (+ 176us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.839632 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260929 06:33:49.839766 11689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.836996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:49563 (local address 127.9.61.67:42517)
0929 06:33:49.837046 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.837047 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.837162 (+ 115us) server_negotiation.cc:407] Connection header received
0929 06:33:49.837217 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.837218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.837227 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.837304 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:33:49.837475 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.837941 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.839028 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.839391 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.839459 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.839470 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.839655 (+ 185us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.839697 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:33:49.839982 11742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.836897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:42517 (local address 127.9.61.66:49563)
0929 06:33:49.837074 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.837084 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.837151 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.837303 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.837304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.837306 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:33:49.837386 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.837388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.838031 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.838032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.838929 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.838932 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.839483 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.839484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.839565 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.839569 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.839834 (+ 265us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.839885 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":30,"thread_start_us":103,"threads_started":1}
I20260929 06:33:49.840008 11345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2988705fcb4e83a82e95ac05db24ed" candidate_uuid: "4647095c5d204cdfb2a039fa72bf6d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f06f5a52733b472b871a049ab9a23bd5" is_pre_election: true
I20260929 06:33:49.840108 11345 raft_consensus.cc:2454] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4647095c5d204cdfb2a039fa72bf6d95 in term 0.
I20260929 06:33:49.840224 11625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2988705fcb4e83a82e95ac05db24ed" candidate_uuid: "4647095c5d204cdfb2a039fa72bf6d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc5531fae19b4877bb25d03c4d735ab4" is_pre_election: true
I20260929 06:33:49.840329 11625 raft_consensus.cc:2454] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4647095c5d204cdfb2a039fa72bf6d95 in term 0.
I20260929 06:33:49.840314 11419 leader_election.cc:302] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4647095c5d204cdfb2a039fa72bf6d95, f06f5a52733b472b871a049ab9a23bd5; no voters:
I20260929 06:33:49.840433 11699 raft_consensus.cc:2781] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:33:49.840473 11699 raft_consensus.cc:482] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:33:49.840503 11699 raft_consensus.cc:3037] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:49.841163 11699 raft_consensus.cc:504] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.841320 11699 leader_election.cc:288] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [CANDIDATE]: Term 1 election: Requested vote from peers f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811), dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67:42517)
I20260929 06:33:49.841526 11625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2988705fcb4e83a82e95ac05db24ed" candidate_uuid: "4647095c5d204cdfb2a039fa72bf6d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc5531fae19b4877bb25d03c4d735ab4"
I20260929 06:33:49.841547 11345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2988705fcb4e83a82e95ac05db24ed" candidate_uuid: "4647095c5d204cdfb2a039fa72bf6d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f06f5a52733b472b871a049ab9a23bd5"
I20260929 06:33:49.841617 11625 raft_consensus.cc:3037] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:49.841615 11345 raft_consensus.cc:3037] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:49.842253 11345 raft_consensus.cc:2454] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4647095c5d204cdfb2a039fa72bf6d95 in term 1.
I20260929 06:33:49.842361 11625 raft_consensus.cc:2454] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4647095c5d204cdfb2a039fa72bf6d95 in term 1.
I20260929 06:33:49.842442 11419 leader_election.cc:302] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4647095c5d204cdfb2a039fa72bf6d95, f06f5a52733b472b871a049ab9a23bd5; no voters:
I20260929 06:33:49.842527 11699 raft_consensus.cc:2781] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:49.842648 11699 raft_consensus.cc:686] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4647095c5d204cdfb2a039fa72bf6d95, State: Running, Role: LEADER
I20260929 06:33:49.842724 11699 consensus_queue.cc:237] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:49.843432 11188 catalog_manager.cc:5495] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66). New cstate: current_term: 1 leader_uuid: "4647095c5d204cdfb2a039fa72bf6d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } health_report { overall_health: UNKNOWN } } }
I20260929 06:33:49.889459 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.885476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58120 (local address 127.9.61.66:42261)
0929 06:33:49.885524 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.885531 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.887288 (+ 1757us) server_negotiation.cc:407] Connection header received
0929 06:33:49.887328 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.887329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.887345 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.887412 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:49.887491 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.887973 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.888710 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.888899 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.888958 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.889103 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:49.889194 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:49.889247 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.889313 (+ 66us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.889329 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:33:49.894204 11689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.891716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:45277 (local address 127.9.61.67:42517)
0929 06:33:49.891790 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.891792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.891911 (+ 119us) server_negotiation.cc:407] Connection header received
0929 06:33:49.892020 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.892021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.892037 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.892108 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:49.892264 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.892714 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.893478 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.893669 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.893753 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.893939 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:49.893973 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:49.894032 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.894109 (+ 77us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.894132 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 06:33:49.894224 11748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.891624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:42517 (local address 127.9.61.66:45277)
0929 06:33:49.891819 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.891829 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.891924 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.892116 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.892116 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.892118 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:33:49.892175 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.892176 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.892800 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.892801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.893393 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.893394 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.893755 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.893756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.893822 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.893842 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:33:49.894033 (+ 191us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:33:49.894036 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.894090 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.894132 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":97,"threads_started":1}
I20260929 06:33:49.896104 11345 raft_consensus.cc:1261] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Refusing update from remote peer 4647095c5d204cdfb2a039fa72bf6d95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:49.896122 11625 raft_consensus.cc:1261] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Refusing update from remote peer 4647095c5d204cdfb2a039fa72bf6d95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:49.896355 11699 consensus_queue.cc:1035] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:49.896662 11744 consensus_queue.cc:1035] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:49.903571 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.901417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:56895 (local address 127.9.61.66:42261)
0929 06:33:49.901483 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:49.901485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:49.901494 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:33:49.901514 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:49.901515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:49.901525 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:49.901584 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:49.901701 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.902145 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.902808 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.903097 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.903167 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.903311 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:49.903345 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:49.903402 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:49.903505 (+ 103us) server_negotiation.cc:299] Negotiation successful
0929 06:33:49.903523 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 06:33:49.903590 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:49.901216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:42261 (local address 127.9.61.67:56895)
0929 06:33:49.901275 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:49.901285 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:49.901321 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:49.901601 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:49.901602 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:49.901603 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:33:49.901645 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.901647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.902206 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.902206 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.902718 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:49.902719 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:49.903169 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:49.903170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:49.903227 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:49.903233 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:33:49.903454 (+ 221us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:33:49.903456 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:33:49.903504 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:33:49.903542 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
W20260929 06:33:49.903926 11721 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260929 06:33:51.422631 11187 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:33:51.422735 11187 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:33:51.423566 11187 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e: Sending DeleteTablet for 3 replicas of tablet 8e2988705fcb4e83a82e95ac05db24ed
I20260929 06:33:51.423872 11461 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e2988705fcb4e83a82e95ac05db24ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:51 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:58114
I20260929 06:33:51.423874 11325 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e2988705fcb4e83a82e95ac05db24ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:51 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:38652
I20260929 06:33:51.424167 11775 tablet_replica.cc:330] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95: stopping tablet replica
I20260929 06:33:51.424242 11776 tablet_replica.cc:330] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5: stopping tablet replica
I20260929 06:33:51.424283 11775 raft_consensus.cc:2229] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:33:51.424309 11776 raft_consensus.cc:2229] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:33:51.424371 11776 raft_consensus.cc:2258] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:51.424376 11775 raft_consensus.cc:2258] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:51.424597 11776 ts_tablet_manager.cc:1905] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:51.424635 11775 ts_tablet_manager.cc:1905] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:51.425470 11605 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e2988705fcb4e83a82e95ac05db24ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:51 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:57514
I20260929 06:33:51.426196 11776 ts_tablet_manager.cc:1918] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 06:33:51.426321 11776 log.cc:1196] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/wal/wals/8e2988705fcb4e83a82e95ac05db24ed
I20260929 06:33:51.426527 11775 ts_tablet_manager.cc:1918] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 06:33:51.426601 11776 ts_tablet_manager.cc:1939] T 8e2988705fcb4e83a82e95ac05db24ed P f06f5a52733b472b871a049ab9a23bd5: Deleting consensus metadata
I20260929 06:33:51.426646 11775 log.cc:1196] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/8e2988705fcb4e83a82e95ac05db24ed
I20260929 06:33:51.426937 11775 ts_tablet_manager.cc:1939] T 8e2988705fcb4e83a82e95ac05db24ed P 4647095c5d204cdfb2a039fa72bf6d95: Deleting consensus metadata
I20260929 06:33:51.426975 11175 catalog_manager.cc:4841] TS f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811): tablet 8e2988705fcb4e83a82e95ac05db24ed (table test-table [id=b1feb6d9ed5d4237a9633b14a619e9e9]) successfully deleted
I20260929 06:33:51.427227 11778 tablet_replica.cc:330] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4: stopping tablet replica
I20260929 06:33:51.427270 11172 catalog_manager.cc:4841] TS 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66:42261): tablet 8e2988705fcb4e83a82e95ac05db24ed (table test-table [id=b1feb6d9ed5d4237a9633b14a619e9e9]) successfully deleted
I20260929 06:33:51.427294 11778 raft_consensus.cc:2229] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:33:51.427333 11778 raft_consensus.cc:2258] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:51.427548 11778 ts_tablet_manager.cc:1905] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:51.428890 11778 ts_tablet_manager.cc:1918] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 06:33:51.428941 11778 log.cc:1196] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/8e2988705fcb4e83a82e95ac05db24ed
I20260929 06:33:51.429145 11778 ts_tablet_manager.cc:1939] T 8e2988705fcb4e83a82e95ac05db24ed P dc5531fae19b4877bb25d03c4d735ab4: Deleting consensus metadata
I20260929 06:33:51.429522 11174 catalog_manager.cc:4841] TS dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67:42517): tablet 8e2988705fcb4e83a82e95ac05db24ed (table test-table [id=b1feb6d9ed5d4237a9633b14a619e9e9]) successfully deleted
Sep 29 06:33:51 dist-test-slave-601b krb5kdc[11143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663631, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 06:33:51 dist-test-slave-601b krb5kdc[11143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663631, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:51.452847 11785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:51.440734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34542 (local address 127.9.61.126:37685)
0929 06:33:51.440887 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:51.440889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:51.440924 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:33:51.440948 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:51.440949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:51.440959 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:51.441014 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:51.441569 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:51.442135 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:51.442917 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:51.443174 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:51.443240 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:51.450112 (+ 6872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:51.450114 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:51.450115 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:51.450123 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:51.451751 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:51.452185 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:51.452186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:51.452186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:51.452243 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:51.452405 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:51.452405 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:51.452406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:51.452510 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:51.452581 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:51.452679 (+ 98us) server_negotiation.cc:299] Negotiation successful
0929 06:33:51.452742 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":99,"threads_started":1}
I20260929 06:33:51.454408 11187 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:33:51.454602 11187 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:33:51.456007 11325 tablet_service.cc:1467] Processing CreateTablet for tablet a870a4dcdbdd433bb3e4448b2b9ebfd1 (DEFAULT_TABLE table=test-table [id=246dab682bd342c3951671cdd1591e9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:51.456044 11605 tablet_service.cc:1467] Processing CreateTablet for tablet a870a4dcdbdd433bb3e4448b2b9ebfd1 (DEFAULT_TABLE table=test-table [id=246dab682bd342c3951671cdd1591e9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:51.456019 11461 tablet_service.cc:1467] Processing CreateTablet for tablet a870a4dcdbdd433bb3e4448b2b9ebfd1 (DEFAULT_TABLE table=test-table [id=246dab682bd342c3951671cdd1591e9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:51.456153 11605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a870a4dcdbdd433bb3e4448b2b9ebfd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:51.456154 11325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a870a4dcdbdd433bb3e4448b2b9ebfd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:51.456175 11461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a870a4dcdbdd433bb3e4448b2b9ebfd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:51.457278 11786 tablet_bootstrap.cc:492] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95: Bootstrap starting.
I20260929 06:33:51.457537 11787 tablet_bootstrap.cc:492] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5: Bootstrap starting.
I20260929 06:33:51.457635 11786 tablet_bootstrap.cc:654] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:51.457819 11788 tablet_bootstrap.cc:492] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4: Bootstrap starting.
I20260929 06:33:51.457962 11787 tablet_bootstrap.cc:654] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:51.458261 11788 tablet_bootstrap.cc:654] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:51.458360 11786 tablet_bootstrap.cc:492] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95: No bootstrap required, opened a new log
I20260929 06:33:51.458423 11786 ts_tablet_manager.cc:1397] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:51.458531 11787 tablet_bootstrap.cc:492] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5: No bootstrap required, opened a new log
I20260929 06:33:51.458580 11787 ts_tablet_manager.cc:1397] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:51.458571 11786 raft_consensus.cc:348] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.458678 11786 raft_consensus.cc:374] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:51.458716 11786 raft_consensus.cc:729] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4647095c5d204cdfb2a039fa72bf6d95, State: Initialized, Role: FOLLOWER
I20260929 06:33:51.458742 11787 raft_consensus.cc:348] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.458796 11788 tablet_bootstrap.cc:492] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4: No bootstrap required, opened a new log
I20260929 06:33:51.458819 11787 raft_consensus.cc:374] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:51.458796 11786 consensus_queue.cc:260] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.458842 11787 raft_consensus.cc:729] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f06f5a52733b472b871a049ab9a23bd5, State: Initialized, Role: FOLLOWER
I20260929 06:33:51.458842 11788 ts_tablet_manager.cc:1397] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:51.458909 11786 ts_tablet_manager.cc:1428] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:51.458943 11788 raft_consensus.cc:348] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.459007 11788 raft_consensus.cc:374] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:51.459075 11788 raft_consensus.cc:729] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc5531fae19b4877bb25d03c4d735ab4, State: Initialized, Role: FOLLOWER
I20260929 06:33:51.459087 11787 consensus_queue.cc:260] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.459146 11788 consensus_queue.cc:260] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.459280 11788 ts_tablet_manager.cc:1428] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:51.459347 11787 ts_tablet_manager.cc:1428] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260929 06:33:51.539387 11768 raft_consensus.cc:482] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:33:51.539551 11768 raft_consensus.cc:504] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.539755 11768 leader_election.cc:288] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811), dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67:42517)
I20260929 06:33:51.540038 11625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a870a4dcdbdd433bb3e4448b2b9ebfd1" candidate_uuid: "4647095c5d204cdfb2a039fa72bf6d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc5531fae19b4877bb25d03c4d735ab4" is_pre_election: true
I20260929 06:33:51.540144 11625 raft_consensus.cc:2454] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4647095c5d204cdfb2a039fa72bf6d95 in term 0.
I20260929 06:33:51.540062 11345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a870a4dcdbdd433bb3e4448b2b9ebfd1" candidate_uuid: "4647095c5d204cdfb2a039fa72bf6d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f06f5a52733b472b871a049ab9a23bd5" is_pre_election: true
I20260929 06:33:51.540184 11345 raft_consensus.cc:2454] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4647095c5d204cdfb2a039fa72bf6d95 in term 0.
I20260929 06:33:51.540328 11418 leader_election.cc:302] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4647095c5d204cdfb2a039fa72bf6d95, dc5531fae19b4877bb25d03c4d735ab4; no voters:
I20260929 06:33:51.540453 11768 raft_consensus.cc:2781] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:33:51.540541 11768 raft_consensus.cc:482] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:33:51.540575 11768 raft_consensus.cc:3037] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:51.541368 11768 raft_consensus.cc:504] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.541532 11768 leader_election.cc:288] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [CANDIDATE]: Term 1 election: Requested vote from peers f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811), dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67:42517)
I20260929 06:33:51.541662 11345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a870a4dcdbdd433bb3e4448b2b9ebfd1" candidate_uuid: "4647095c5d204cdfb2a039fa72bf6d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f06f5a52733b472b871a049ab9a23bd5"
I20260929 06:33:51.541743 11345 raft_consensus.cc:3037] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:51.541675 11625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a870a4dcdbdd433bb3e4448b2b9ebfd1" candidate_uuid: "4647095c5d204cdfb2a039fa72bf6d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc5531fae19b4877bb25d03c4d735ab4"
I20260929 06:33:51.541774 11625 raft_consensus.cc:3037] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:51.542368 11345 raft_consensus.cc:2454] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4647095c5d204cdfb2a039fa72bf6d95 in term 1.
I20260929 06:33:51.542572 11419 leader_election.cc:302] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4647095c5d204cdfb2a039fa72bf6d95, f06f5a52733b472b871a049ab9a23bd5; no voters:
I20260929 06:33:51.542618 11625 raft_consensus.cc:2454] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4647095c5d204cdfb2a039fa72bf6d95 in term 1.
I20260929 06:33:51.542703 11768 raft_consensus.cc:2781] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:51.542770 11768 raft_consensus.cc:686] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4647095c5d204cdfb2a039fa72bf6d95, State: Running, Role: LEADER
I20260929 06:33:51.542830 11768 consensus_queue.cc:237] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.543457 11187 catalog_manager.cc:5495] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66). New cstate: current_term: 1 leader_uuid: "4647095c5d204cdfb2a039fa72bf6d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } health_report { overall_health: UNKNOWN } } }
I20260929 06:33:51.556080 11795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:51.553550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58134 (local address 127.9.61.66:42261)
0929 06:33:51.553717 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:51.553719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:51.553726 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:33:51.553754 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:51.553754 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:51.553764 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:51.553844 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:51.553999 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:51.554503 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:51.555312 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:51.555551 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:51.555631 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:51.555798 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:51.555839 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:51.555882 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:51.555961 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 06:33:51.555985 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":95,"threads_started":1}
I20260929 06:33:51.558650 11345 raft_consensus.cc:1261] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Refusing update from remote peer 4647095c5d204cdfb2a039fa72bf6d95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:51.558677 11625 raft_consensus.cc:1261] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Refusing update from remote peer 4647095c5d204cdfb2a039fa72bf6d95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:51.558915 11765 consensus_queue.cc:1035] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:51.559091 11768 consensus_queue.cc:1035] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:51.569380 11186 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:33:51.569481 11186 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:33:51.570153 11186 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e: Sending DeleteTablet for 3 replicas of tablet a870a4dcdbdd433bb3e4448b2b9ebfd1
I20260929 06:33:51.570379 11325 tablet_service.cc:1514] Processing DeleteTablet for tablet a870a4dcdbdd433bb3e4448b2b9ebfd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:51 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:38652
I20260929 06:33:51.570410 11605 tablet_service.cc:1514] Processing DeleteTablet for tablet a870a4dcdbdd433bb3e4448b2b9ebfd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:51 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:57514
I20260929 06:33:51.570477 11776 tablet_replica.cc:330] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5: stopping tablet replica
I20260929 06:33:51.570531 11778 tablet_replica.cc:330] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4: stopping tablet replica
I20260929 06:33:51.570544 11776 raft_consensus.cc:2229] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:33:51.570588 11776 raft_consensus.cc:2258] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:51.570590 11778 raft_consensus.cc:2229] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:33:51.570653 11778 raft_consensus.cc:2258] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:51.570674 11461 tablet_service.cc:1514] Processing DeleteTablet for tablet a870a4dcdbdd433bb3e4448b2b9ebfd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:51 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:58114
I20260929 06:33:51.570670 11186 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260929 06:33:51.570751 11775 tablet_replica.cc:330] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95: stopping tablet replica
I20260929 06:33:51.570791 11775 raft_consensus.cc:2229] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 LEADER]: Raft consensus shutting down.
W20260929 06:33:51.570802 11186 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:33:51.570837 11775 raft_consensus.cc:2258] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:51.571156 11775 ts_tablet_manager.cc:1905] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:51.571230 11778 ts_tablet_manager.cc:1905] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:51.572067 11461 tablet_service.cc:1467] Processing CreateTablet for tablet 182a1d9f3852447fbe56a7333a879cda (DEFAULT_TABLE table=test-table [id=26b6def18d454f99b416048a993b1a76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:51.572171 11461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 182a1d9f3852447fbe56a7333a879cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:51.572153 11325 tablet_service.cc:1467] Processing CreateTablet for tablet 182a1d9f3852447fbe56a7333a879cda (DEFAULT_TABLE table=test-table [id=26b6def18d454f99b416048a993b1a76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:51.572264 11325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 182a1d9f3852447fbe56a7333a879cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:51.572825 11775 ts_tablet_manager.cc:1918] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:33:51.572846 11778 ts_tablet_manager.cc:1918] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:33:51.572875 11775 log.cc:1196] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/a870a4dcdbdd433bb3e4448b2b9ebfd1
I20260929 06:33:51.572901 11778 log.cc:1196] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/a870a4dcdbdd433bb3e4448b2b9ebfd1
I20260929 06:33:51.573099 11775 ts_tablet_manager.cc:1939] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P 4647095c5d204cdfb2a039fa72bf6d95: Deleting consensus metadata
I20260929 06:33:51.573153 11778 ts_tablet_manager.cc:1939] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P dc5531fae19b4877bb25d03c4d735ab4: Deleting consensus metadata
I20260929 06:33:51.573585 11786 tablet_bootstrap.cc:492] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95: Bootstrap starting.
I20260929 06:33:51.573635 11172 catalog_manager.cc:4841] TS 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66:42261): tablet a870a4dcdbdd433bb3e4448b2b9ebfd1 (table test-table [id=246dab682bd342c3951671cdd1591e9f]) successfully deleted
I20260929 06:33:51.573748 11787 tablet_bootstrap.cc:492] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5: Bootstrap starting.
I20260929 06:33:51.573918 11786 tablet_bootstrap.cc:654] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:51.574048 11787 tablet_bootstrap.cc:654] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:51.574342 11605 tablet_service.cc:1467] Processing CreateTablet for tablet 182a1d9f3852447fbe56a7333a879cda (DEFAULT_TABLE table=test-table [id=26b6def18d454f99b416048a993b1a76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:33:51.574486 11786 tablet_bootstrap.cc:492] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95: No bootstrap required, opened a new log
I20260929 06:33:51.574488 11605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 182a1d9f3852447fbe56a7333a879cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:51.574519 11786 ts_tablet_manager.cc:1397] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:51.574596 11786 raft_consensus.cc:348] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.574641 11786 raft_consensus.cc:374] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:51.574653 11786 raft_consensus.cc:729] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4647095c5d204cdfb2a039fa72bf6d95, State: Initialized, Role: FOLLOWER
I20260929 06:33:51.574712 11786 consensus_queue.cc:260] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.574802 11786 ts_tablet_manager.cc:1428] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:51.575577 11788 tablet_bootstrap.cc:492] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4: Bootstrap starting.
I20260929 06:33:51.575848 11174 catalog_manager.cc:4841] TS dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67:42517): tablet a870a4dcdbdd433bb3e4448b2b9ebfd1 (table test-table [id=246dab682bd342c3951671cdd1591e9f]) successfully deleted
I20260929 06:33:51.575968 11788 tablet_bootstrap.cc:654] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:51.576014 11776 ts_tablet_manager.cc:1905] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:51.576560 11788 tablet_bootstrap.cc:492] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4: No bootstrap required, opened a new log
I20260929 06:33:51.576601 11788 ts_tablet_manager.cc:1397] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:51.576735 11788 raft_consensus.cc:348] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.576803 11788 raft_consensus.cc:374] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:51.576817 11788 raft_consensus.cc:729] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc5531fae19b4877bb25d03c4d735ab4, State: Initialized, Role: FOLLOWER
I20260929 06:33:51.576870 11788 consensus_queue.cc:260] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.576972 11788 ts_tablet_manager.cc:1428] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:51.577508 11776 ts_tablet_manager.cc:1918] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:33:51.577590 11776 log.cc:1196] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-0/wal/wals/a870a4dcdbdd433bb3e4448b2b9ebfd1
I20260929 06:33:51.577806 11776 ts_tablet_manager.cc:1939] T a870a4dcdbdd433bb3e4448b2b9ebfd1 P f06f5a52733b472b871a049ab9a23bd5: Deleting consensus metadata
I20260929 06:33:51.578105 11175 catalog_manager.cc:4841] TS f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811): tablet a870a4dcdbdd433bb3e4448b2b9ebfd1 (table test-table [id=246dab682bd342c3951671cdd1591e9f]) successfully deleted
I20260929 06:33:51.578372 11787 tablet_bootstrap.cc:492] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5: No bootstrap required, opened a new log
I20260929 06:33:51.578444 11787 ts_tablet_manager.cc:1397] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20260929 06:33:51.578576 11787 raft_consensus.cc:348] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.578635 11787 raft_consensus.cc:374] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:51.578648 11787 raft_consensus.cc:729] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f06f5a52733b472b871a049ab9a23bd5, State: Initialized, Role: FOLLOWER
I20260929 06:33:51.578703 11787 consensus_queue.cc:260] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.578807 11787 ts_tablet_manager.cc:1428] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:51.614154 11770 raft_consensus.cc:482] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:33:51.614267 11770 raft_consensus.cc:504] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.614440 11770 leader_election.cc:288] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811), 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66:42261)
I20260929 06:33:51.614677 11485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "182a1d9f3852447fbe56a7333a879cda" candidate_uuid: "dc5531fae19b4877bb25d03c4d735ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4647095c5d204cdfb2a039fa72bf6d95" is_pre_election: true
I20260929 06:33:51.614677 11345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "182a1d9f3852447fbe56a7333a879cda" candidate_uuid: "dc5531fae19b4877bb25d03c4d735ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f06f5a52733b472b871a049ab9a23bd5" is_pre_election: true
I20260929 06:33:51.614796 11485 raft_consensus.cc:2454] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc5531fae19b4877bb25d03c4d735ab4 in term 0.
I20260929 06:33:51.614796 11345 raft_consensus.cc:2454] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc5531fae19b4877bb25d03c4d735ab4 in term 0.
I20260929 06:33:51.614976 11559 leader_election.cc:302] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc5531fae19b4877bb25d03c4d735ab4, f06f5a52733b472b871a049ab9a23bd5; no voters:
I20260929 06:33:51.615120 11770 raft_consensus.cc:2781] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:33:51.615196 11770 raft_consensus.cc:482] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:33:51.615231 11770 raft_consensus.cc:3037] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:51.616034 11770 raft_consensus.cc:504] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.616199 11770 leader_election.cc:288] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [CANDIDATE]: Term 1 election: Requested vote from peers f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811), 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66:42261)
I20260929 06:33:51.616369 11345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "182a1d9f3852447fbe56a7333a879cda" candidate_uuid: "dc5531fae19b4877bb25d03c4d735ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f06f5a52733b472b871a049ab9a23bd5"
I20260929 06:33:51.616465 11345 raft_consensus.cc:3037] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:51.616392 11485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "182a1d9f3852447fbe56a7333a879cda" candidate_uuid: "dc5531fae19b4877bb25d03c4d735ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4647095c5d204cdfb2a039fa72bf6d95"
I20260929 06:33:51.616539 11485 raft_consensus.cc:3037] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:51.617089 11345 raft_consensus.cc:2454] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc5531fae19b4877bb25d03c4d735ab4 in term 1.
I20260929 06:33:51.617167 11485 raft_consensus.cc:2454] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc5531fae19b4877bb25d03c4d735ab4 in term 1.
I20260929 06:33:51.617352 11559 leader_election.cc:302] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc5531fae19b4877bb25d03c4d735ab4, f06f5a52733b472b871a049ab9a23bd5; no voters:
I20260929 06:33:51.617462 11770 raft_consensus.cc:2781] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:51.617527 11770 raft_consensus.cc:686] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 1 LEADER]: Becoming Leader. State: Replica: dc5531fae19b4877bb25d03c4d735ab4, State: Running, Role: LEADER
I20260929 06:33:51.617579 11770 consensus_queue.cc:237] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } }
I20260929 06:33:51.618237 11186 catalog_manager.cc:5495] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67). New cstate: current_term: 1 leader_uuid: "dc5531fae19b4877bb25d03c4d735ab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc5531fae19b4877bb25d03c4d735ab4" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42517 } health_report { overall_health: HEALTHY } } }
I20260929 06:33:51.636554 11803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:51.634334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57540 (local address 127.9.61.67:42517)
0929 06:33:51.634515 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:51.634517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:51.634525 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:33:51.634556 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:51.634556 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:51.634567 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:51.634625 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:51.634726 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:51.635211 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:51.635892 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:51.636167 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:51.636222 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:51.636341 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:51.636370 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:51.636418 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:51.636467 (+ 49us) server_negotiation.cc:299] Negotiation successful
0929 06:33:51.636485 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":131,"threads_started":1}
I20260929 06:33:51.640906 11806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:51.638560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:42517 (local address 127.9.61.67:38163)
0929 06:33:51.638701 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:51.638718 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:51.638767 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:51.638876 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:51.638877 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:51.638878 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:33:51.638915 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:51.638916 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:51.639487 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:51.639488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:51.640197 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:51.640228 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:51.640555 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:51.640556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:51.640596 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:51.640600 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:33:51.640720 (+ 120us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:33:51.640722 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:33:51.640755 (+ 33us) client_negotiation.cc:240] Negotiation successful
0929 06:33:51.640817 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":94,"threads_started":1}
I20260929 06:33:51.640909 11803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:51.638680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:38163 (local address 127.9.61.67:42517)
0929 06:33:51.638714 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:51.638716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:51.638755 (+ 39us) server_negotiation.cc:407] Connection header received
0929 06:33:51.638806 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:51.638807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:51.638814 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:51.638869 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:33:51.638949 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:51.639405 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:51.640310 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:51.640491 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:51.640546 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:51.640651 (+ 105us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:33:51.640677 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:33:51.640710 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:51.640756 (+ 46us) server_negotiation.cc:299] Negotiation successful
0929 06:33:51.640788 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260929 06:33:51.643036 11485 raft_consensus.cc:1261] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Refusing update from remote peer dc5531fae19b4877bb25d03c4d735ab4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:51.643049 11345 raft_consensus.cc:1261] T 182a1d9f3852447fbe56a7333a879cda P f06f5a52733b472b871a049ab9a23bd5 [term 1 FOLLOWER]: Refusing update from remote peer dc5531fae19b4877bb25d03c4d735ab4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:33:51.643251 11713 consensus_queue.cc:1035] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f06f5a52733b472b871a049ab9a23bd5" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:33:51.643340 11770 consensus_queue.cc:1035] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4647095c5d204cdfb2a039fa72bf6d95" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 42261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 06:33:51.647959 11754 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260929 06:33:53.166290 11186 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:33:53.166389 11186 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:33:53.167133 11186 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e744d69edb524e97923255dd0562aa5e: Sending DeleteTablet for 3 replicas of tablet 182a1d9f3852447fbe56a7333a879cda
I20260929 06:33:53.167419 11605 tablet_service.cc:1514] Processing DeleteTablet for tablet 182a1d9f3852447fbe56a7333a879cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:53 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:57514
I20260929 06:33:53.167448 11325 tablet_service.cc:1514] Processing DeleteTablet for tablet 182a1d9f3852447fbe56a7333a879cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:53 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:38652
I20260929 06:33:53.167624 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 11260
I20260929 06:33:53.167619 11461 tablet_service.cc:1514] Processing DeleteTablet for tablet 182a1d9f3852447fbe56a7333a879cda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:33:53 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:58114
I20260929 06:33:53.172048 11829 tablet_replica.cc:330] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4: stopping tablet replica
I20260929 06:33:53.172153 11829 raft_consensus.cc:2229] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:33:53.172241 11831 tablet_replica.cc:330] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95: stopping tablet replica
I20260929 06:33:53.172276 11829 raft_consensus.cc:2258] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:53.172307 11831 raft_consensus.cc:2229] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:33:53.172348 11831 raft_consensus.cc:2258] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:33:53.172612 11829 ts_tablet_manager.cc:1905] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:53.172612 11831 ts_tablet_manager.cc:1905] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:33:53.174381 11829 ts_tablet_manager.cc:1918] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 06:33:53.174381 11831 ts_tablet_manager.cc:1918] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260929 06:33:53.174445 11831 log.cc:1196] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/182a1d9f3852447fbe56a7333a879cda
I20260929 06:33:53.174445 11829 log.cc:1196] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/182a1d9f3852447fbe56a7333a879cda
I20260929 06:33:53.174675 11831 ts_tablet_manager.cc:1939] T 182a1d9f3852447fbe56a7333a879cda P 4647095c5d204cdfb2a039fa72bf6d95: Deleting consensus metadata
I20260929 06:33:53.174741 11829 ts_tablet_manager.cc:1939] T 182a1d9f3852447fbe56a7333a879cda P dc5531fae19b4877bb25d03c4d735ab4: Deleting consensus metadata
I20260929 06:33:53.175002 11172 catalog_manager.cc:4841] TS 4647095c5d204cdfb2a039fa72bf6d95 (127.9.61.66:42261): tablet 182a1d9f3852447fbe56a7333a879cda (table test-table [id=26b6def18d454f99b416048a993b1a76]) successfully deleted
I20260929 06:33:53.175010 11174 catalog_manager.cc:4841] TS dc5531fae19b4877bb25d03c4d735ab4 (127.9.61.67:42517): tablet 182a1d9f3852447fbe56a7333a879cda (table test-table [id=26b6def18d454f99b416048a993b1a76]) successfully deleted
W20260929 06:33:53.176134 11175 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:43811 (error 108)
I20260929 06:33:53.176338 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 11400
I20260929 06:33:53.177145 11833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:53.176478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43811 (local address 127.0.0.1:55398)
0929 06:33:53.177049 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:53.177098 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:43811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":56,"threads_started":1}
W20260929 06:33:53.177278 11175 catalog_manager.cc:4584] TS f06f5a52733b472b871a049ab9a23bd5 (127.9.61.65:43811): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 182a1d9f3852447fbe56a7333a879cda: Network error: Client connection negotiation failed: client connection to 127.9.61.65:43811: connect: Connection refused (error 111)
I20260929 06:33:53.182581 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 11540
I20260929 06:33:53.188362 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 11156
2026-09-29T06:33:53Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5570 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:33:53 dist-test-slave-601b krb5kdc[11836](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:33:53 dist-test-slave-601b krb5kdc[11836](info): set up 2 sockets
Sep 29 06:33:53 dist-test-slave-601b krb5kdc[11836](info): commencing operation
krb5kdc: starting...
W20260929 06:33:54.223788 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.015s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:33:54 dist-test-slave-601b krb5kdc[11836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:33:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:33:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:33:54.343189 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:38825
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:38825
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:54.426527 11849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:54.426808 11849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:54.426846 11849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:54.428180 11849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:33:54.428254 11849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:54.428275 11849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:54.428294 11849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:33:54.428326 11849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:33:54.429908 11849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:38825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:38825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:54.430231 11849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:54.430486 11849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:54.435492 11854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:54.435431 11857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:54.435431 11855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:54.435768 11849 server_base.cc:1034] running on GCE node
I20260929 06:33:54.436094 11849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:54.436425 11849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:54.437577 11849 hybrid_clock.cc:648] HybridClock initialized: now 1790663634437566 us; error 31 us; skew 500 ppm
Sep 29 06:33:54 dist-test-slave-601b krb5kdc[11836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663634, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:54.440192 11849 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:33:54.440689 11849 webserver.cc:460] Webserver started at http://127.9.61.126:46367/ using document root <none> and password file <none>
I20260929 06:33:54.440941 11849 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:54.440994 11849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:54.441123 11849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:54.442360 11849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "51fcb6f48f7c4e4cbf3ee596a0f9345a"
format_stamp: "Formatted at 2026-09-29 06:33:54 on dist-test-slave-601b"
server_key: "d845055f266ab45979f6e39252a83313"
server_key_iv: "27dc1521337faa53d8aac986ba8b6a8d"
server_key_version: "encryptionkey@0"
I20260929 06:33:54.442740 11849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "51fcb6f48f7c4e4cbf3ee596a0f9345a"
format_stamp: "Formatted at 2026-09-29 06:33:54 on dist-test-slave-601b"
server_key: "d845055f266ab45979f6e39252a83313"
server_key_iv: "27dc1521337faa53d8aac986ba8b6a8d"
server_key_version: "encryptionkey@0"
I20260929 06:33:54.444244 11849 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:33:54.445004 11864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:54.445190 11849 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:54.445281 11849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "51fcb6f48f7c4e4cbf3ee596a0f9345a"
format_stamp: "Formatted at 2026-09-29 06:33:54 on dist-test-slave-601b"
server_key: "d845055f266ab45979f6e39252a83313"
server_key_iv: "27dc1521337faa53d8aac986ba8b6a8d"
server_key_version: "encryptionkey@0"
I20260929 06:33:54.445364 11849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:54.467346 11849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:54.469460 11849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:54.469638 11849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:54.473755 11849 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:38825
I20260929 06:33:54.473793 11916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:38825 every 8 connection(s)
I20260929 06:33:54.474161 11849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:33:54.475068 11917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:54.477427 11917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a: Bootstrap starting.
I20260929 06:33:54.478006 11917 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:54.478317 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 11849
I20260929 06:33:54.478372 11917 log.cc:824] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:54.478412 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:33:54.478593 9461 external_mini_cluster.cc:1428] Setting key f26f2f750c409e7353dcc9b878821939
I20260929 06:33:54.479254 11917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a: No bootstrap required, opened a new log
I20260929 06:33:54.481997 11917 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51fcb6f48f7c4e4cbf3ee596a0f9345a" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38825 } }
I20260929 06:33:54.482185 11917 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:54.482221 11917 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51fcb6f48f7c4e4cbf3ee596a0f9345a, State: Initialized, Role: FOLLOWER
I20260929 06:33:54.482357 11917 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51fcb6f48f7c4e4cbf3ee596a0f9345a" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38825 } }
I20260929 06:33:54.482430 11917 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:33:54.482460 11917 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:33:54.482504 11917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:54.483160 11917 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51fcb6f48f7c4e4cbf3ee596a0f9345a" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38825 } }
I20260929 06:33:54.483284 11917 leader_election.cc:302] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51fcb6f48f7c4e4cbf3ee596a0f9345a; no voters:
I20260929 06:33:54.483551 11917 leader_election.cc:288] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:33:54.483626 11922 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:54.483856 11917 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:33:54.483891 11922 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [term 1 LEADER]: Becoming Leader. State: Replica: 51fcb6f48f7c4e4cbf3ee596a0f9345a, State: Running, Role: LEADER
I20260929 06:33:54.484122 11922 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51fcb6f48f7c4e4cbf3ee596a0f9345a" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38825 } }
I20260929 06:33:54.485298 11924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51fcb6f48f7c4e4cbf3ee596a0f9345a. Latest consensus state: current_term: 1 leader_uuid: "51fcb6f48f7c4e4cbf3ee596a0f9345a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51fcb6f48f7c4e4cbf3ee596a0f9345a" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38825 } } }
I20260929 06:33:54.485380 11924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [sys.catalog]: This master's current role is: LEADER
Sep 29 06:33:54 dist-test-slave-601b krb5kdc[11836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:54.485560 11923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51fcb6f48f7c4e4cbf3ee596a0f9345a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51fcb6f48f7c4e4cbf3ee596a0f9345a" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38825 } } }
I20260929 06:33:54.485896 11923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a [sys.catalog]: This master's current role is: LEADER
W20260929 06:33:54.486029 11937 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:33:54.486091 11937 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:33:54.486141 11938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:33:54.486325 11938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:33:54.488256 11938 catalog_manager.cc:1347] Generated new cluster ID: 8792112c818c4787a91bb54a3824bace
I20260929 06:33:54.488314 11938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:33:54.490170 11921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:54.479175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48700 (local address 127.9.61.126:38825)
0929 06:33:54.479344 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:54.479353 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:54.479386 (+ 33us) server_negotiation.cc:407] Connection header received
0929 06:33:54.479834 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:54.479841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:54.479890 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:54.480082 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:54.480830 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.481718 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.482759 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.483172 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.483288 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:54.486434 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:54.486438 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:54.486438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:54.486451 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:54.488548 (+ 2097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:54.488926 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:54.488930 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:54.488930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:54.489036 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:54.489251 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:54.489252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:54.489253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:54.489505 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:54.489681 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:54.489791 (+ 110us) server_negotiation.cc:299] Negotiation successful
0929 06:33:54.489934 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":86,"threads_started":1}
I20260929 06:33:54.498787 11938 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:33:54.499358 11938 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:33:54.505898 11938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51fcb6f48f7c4e4cbf3ee596a0f9345a: Generated new TSK 0
I20260929 06:33:54.506134 11938 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:33:54.534392 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38825
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:54.619240 11943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:54.619455 11943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:54.619483 11943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:54.620806 11943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:54.620863 11943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:54.620893 11943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:33:54.622412 11943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38825
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:54.622682 11943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:54.622943 11943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:54.628142 11948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:54.628155 11951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:54.628149 11949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:54.628212 11943 server_base.cc:1034] running on GCE node
I20260929 06:33:54.628552 11943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:54.628765 11943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:54.629909 11943 hybrid_clock.cc:648] HybridClock initialized: now 1790663634629888 us; error 38 us; skew 500 ppm
Sep 29 06:33:54 dist-test-slave-601b krb5kdc[11836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663634, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:54.632625 11943 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:33:54.633152 11943 webserver.cc:460] Webserver started at http://127.9.61.65:39705/ using document root <none> and password file <none>
I20260929 06:33:54.633405 11943 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:54.633481 11943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:54.633630 11943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:54.634743 11943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "14f155eefbc54427b52228a6fae2eacc"
format_stamp: "Formatted at 2026-09-29 06:33:54 on dist-test-slave-601b"
server_key: "045774da68b5ccfba156b3885a54d1c5"
server_key_iv: "919499cbae0cd3759d2fdcad284b75b5"
server_key_version: "encryptionkey@0"
I20260929 06:33:54.635116 11943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "14f155eefbc54427b52228a6fae2eacc"
format_stamp: "Formatted at 2026-09-29 06:33:54 on dist-test-slave-601b"
server_key: "045774da68b5ccfba156b3885a54d1c5"
server_key_iv: "919499cbae0cd3759d2fdcad284b75b5"
server_key_version: "encryptionkey@0"
I20260929 06:33:54.636587 11943 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:33:54.637401 11958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:54.637591 11943 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:54.637688 11943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "14f155eefbc54427b52228a6fae2eacc"
format_stamp: "Formatted at 2026-09-29 06:33:54 on dist-test-slave-601b"
server_key: "045774da68b5ccfba156b3885a54d1c5"
server_key_iv: "919499cbae0cd3759d2fdcad284b75b5"
server_key_version: "encryptionkey@0"
I20260929 06:33:54.637773 11943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:54.647286 11943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:54.649469 11943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:54.649627 11943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:54.649866 11943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:54.650177 11943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:54.650231 11943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:54.650273 11943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:54.650322 11943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:54.656596 11943 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:36695
I20260929 06:33:54.656649 12071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:36695 every 8 connection(s)
I20260929 06:33:54.657069 11943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:33:54.659611 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 11943
I20260929 06:33:54.659716 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:33:54.659910 9461 external_mini_cluster.cc:1428] Setting key 2e7d5ef0429fe6d18b7c99a2707efbef
Sep 29 06:33:54 dist-test-slave-601b krb5kdc[11836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663634, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
I20260929 06:33:54.668408 11921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:54.657876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:53183 (local address 127.9.61.126:38825)
0929 06:33:54.657944 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:54.657946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:54.658151 (+ 205us) server_negotiation.cc:407] Connection header received
0929 06:33:54.658649 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:54.658650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:54.658661 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:54.658731 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:54.659897 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.660566 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.662165 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.662534 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.662623 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:54.665346 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:54.665353 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:54.665353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:54.665361 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:54.666838 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:54.667285 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:54.667287 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:54.667287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:54.667348 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:54.667610 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:54.667611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:54.667611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:54.667736 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:54.667810 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:54.668195 (+ 385us) server_negotiation.cc:299] Negotiation successful
0929 06:33:54.668285 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:33:54.668638 12074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:54.657849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38825 (local address 127.9.61.65:53183)
0929 06:33:54.658010 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:54.658054 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:54.658556 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:54.658790 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:54.658794 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:54.659443 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:54.659766 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:54.659774 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.660674 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.660675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:54.662048 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:54.662051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.662661 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.662662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:54.662779 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:54.663425 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:54.663436 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:54.665194 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:54.666946 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:54.666954 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:54.666956 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:54.667204 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:54.667419 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:54.667420 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:54.667420 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:54.667538 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:54.667815 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:54.667822 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:54.668031 (+ 209us) client_negotiation.cc:769] Sending connection context
0929 06:33:54.668176 (+ 145us) client_negotiation.cc:240] Negotiation successful
0929 06:33:54.668396 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
I20260929 06:33:54.669169 12072 heartbeater.cc:347] Connected to a master server at 127.9.61.126:38825
I20260929 06:33:54.669281 12072 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:54.669466 12072 heartbeater.cc:511] Master 127.9.61.126:38825 requested a full tablet report, sending...
I20260929 06:33:54.670061 11881 ts_manager.cc:194] Registered new tserver with Master: 14f155eefbc54427b52228a6fae2eacc (127.9.61.65:36695)
I20260929 06:33:54.670760 11881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:53183
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:33:54.684891 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38825
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:54.768961 12077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:54.769196 12077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:54.769219 12077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:54.770427 12077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:54.770471 12077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:54.770500 12077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:33:54.771883 12077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38825
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:54.772146 12077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:54.772337 12077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:54.777139 12085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:54.777138 12083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:54.777166 12082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:54.777482 12077 server_base.cc:1034] running on GCE node
I20260929 06:33:54.777710 12077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:54.777962 12077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:54.779124 12077 hybrid_clock.cc:648] HybridClock initialized: now 1790663634779108 us; error 30 us; skew 500 ppm
Sep 29 06:33:54 dist-test-slave-601b krb5kdc[11836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663634, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:54.781734 12077 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:33:54.782229 12077 webserver.cc:460] Webserver started at http://127.9.61.66:36093/ using document root <none> and password file <none>
I20260929 06:33:54.782464 12077 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:54.782512 12077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:54.782644 12077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:54.783722 12077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "55d27cabd6af4d7fb779322c5c3fb8a3"
format_stamp: "Formatted at 2026-09-29 06:33:54 on dist-test-slave-601b"
server_key: "900b25a6ab5d56a409c313b840570e98"
server_key_iv: "f6c26f176b12a35590d758805f3c6550"
server_key_version: "encryptionkey@0"
I20260929 06:33:54.784107 12077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "55d27cabd6af4d7fb779322c5c3fb8a3"
format_stamp: "Formatted at 2026-09-29 06:33:54 on dist-test-slave-601b"
server_key: "900b25a6ab5d56a409c313b840570e98"
server_key_iv: "f6c26f176b12a35590d758805f3c6550"
server_key_version: "encryptionkey@0"
I20260929 06:33:54.785535 12077 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:54.786314 12092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:54.786484 12077 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:54.786590 12077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "55d27cabd6af4d7fb779322c5c3fb8a3"
format_stamp: "Formatted at 2026-09-29 06:33:54 on dist-test-slave-601b"
server_key: "900b25a6ab5d56a409c313b840570e98"
server_key_iv: "f6c26f176b12a35590d758805f3c6550"
server_key_version: "encryptionkey@0"
I20260929 06:33:54.786664 12077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:54.808247 12077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:54.810247 12077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:54.810415 12077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:54.810671 12077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:54.810994 12077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:54.811049 12077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:54.811085 12077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:54.811111 12077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:54.816811 12077 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:40455
I20260929 06:33:54.816857 12205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:40455 every 8 connection(s)
I20260929 06:33:54.817183 12077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:33:54.820169 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 12077
I20260929 06:33:54.820293 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:33:54.820529 9461 external_mini_cluster.cc:1428] Setting key ba210f8c81777c8e23e939926a7d24b2
Sep 29 06:33:54 dist-test-slave-601b krb5kdc[11836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663634, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:54.827031 11921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:54.817905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:42581 (local address 127.9.61.126:38825)
0929 06:33:54.817975 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:54.817977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:54.818168 (+ 191us) server_negotiation.cc:407] Connection header received
0929 06:33:54.818693 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:54.818698 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:54.818709 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:54.818804 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:54.819712 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.820309 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.821499 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.821716 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.821810 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:54.824090 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:54.824091 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:54.824092 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:54.824098 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:54.825522 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:54.826042 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:54.826043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:54.826043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:54.826094 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:54.826384 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:54.826384 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:54.826385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:54.826507 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:54.826556 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:54.826903 (+ 347us) server_negotiation.cc:299] Negotiation successful
0929 06:33:54.826964 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 06:33:54.827307 12208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:54.817861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38825 (local address 127.9.61.66:42581)
0929 06:33:54.818032 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:54.818074 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:54.818603 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:54.818862 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:54.818866 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:54.819434 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:54.819632 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:54.819637 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.820406 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.820407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:54.821395 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:54.821397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.821831 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.821832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:54.821951 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:54.822508 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:54.822516 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:54.823989 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:54.825608 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:54.825614 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:54.825616 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:54.825962 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:54.826161 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:54.826162 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:54.826163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:54.826310 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:54.826572 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:54.826577 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:54.826754 (+ 177us) client_negotiation.cc:769] Sending connection context
0929 06:33:54.826886 (+ 132us) client_negotiation.cc:240] Negotiation successful
0929 06:33:54.827057 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":104,"threads_started":1}
I20260929 06:33:54.827912 12206 heartbeater.cc:347] Connected to a master server at 127.9.61.126:38825
I20260929 06:33:54.828085 12206 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:54.828294 12206 heartbeater.cc:511] Master 127.9.61.126:38825 requested a full tablet report, sending...
I20260929 06:33:54.828711 11881 ts_manager.cc:194] Registered new tserver with Master: 55d27cabd6af4d7fb779322c5c3fb8a3 (127.9.61.66:40455)
I20260929 06:33:54.829078 11881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:42581
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:33:54.844792 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38825
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:54.924973 12211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:54.925233 12211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:54.925271 12211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:54.926446 12211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:54.926523 12211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:54.926563 12211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:33:54.928068 12211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38825
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:54.928344 12211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:54.928579 12211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:54.933647 12216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:54.933696 12217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:54.933647 12219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:54.933807 12211 server_base.cc:1034] running on GCE node
I20260929 06:33:54.934095 12211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:54.934353 12211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:54.935515 12211 hybrid_clock.cc:648] HybridClock initialized: now 1790663634935505 us; error 31 us; skew 500 ppm
Sep 29 06:33:54 dist-test-slave-601b krb5kdc[11836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663634, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:54.938107 12211 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:33:54.938587 12211 webserver.cc:460] Webserver started at http://127.9.61.67:39861/ using document root <none> and password file <none>
I20260929 06:33:54.938822 12211 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:54.938887 12211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:54.939047 12211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:54.940193 12211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "24ce3e24481e48c1817568eab964484e"
format_stamp: "Formatted at 2026-09-29 06:33:54 on dist-test-slave-601b"
server_key: "c1f7af4772295cfcaa0169b80f2a390b"
server_key_iv: "48f63e836bd36c575455b4a48d5eef3c"
server_key_version: "encryptionkey@0"
I20260929 06:33:54.940551 12211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "24ce3e24481e48c1817568eab964484e"
format_stamp: "Formatted at 2026-09-29 06:33:54 on dist-test-slave-601b"
server_key: "c1f7af4772295cfcaa0169b80f2a390b"
server_key_iv: "48f63e836bd36c575455b4a48d5eef3c"
server_key_version: "encryptionkey@0"
I20260929 06:33:54.941895 12211 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:54.942670 12226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:54.942862 12211 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:54.942963 12211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "24ce3e24481e48c1817568eab964484e"
format_stamp: "Formatted at 2026-09-29 06:33:54 on dist-test-slave-601b"
server_key: "c1f7af4772295cfcaa0169b80f2a390b"
server_key_iv: "48f63e836bd36c575455b4a48d5eef3c"
server_key_version: "encryptionkey@0"
I20260929 06:33:54.943043 12211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:54.962980 12211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:54.965502 12211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:54.965674 12211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:54.965929 12211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:54.966259 12211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:54.966331 12211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:54.966369 12211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:54.966396 12211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:54.972325 12211 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:41343
I20260929 06:33:54.972368 12339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:41343 every 8 connection(s)
I20260929 06:33:54.972718 12211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:33:54 dist-test-slave-601b krb5kdc[11836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663634, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:54.979596 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 12211
I20260929 06:33:54.979718 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:33:54.979970 9461 external_mini_cluster.cc:1428] Setting key ebdd856d580376d6802b439225001321
I20260929 06:33:54.982625 11921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:54.973519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:51977 (local address 127.9.61.126:38825)
0929 06:33:54.973583 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:54.973585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:54.973806 (+ 221us) server_negotiation.cc:407] Connection header received
0929 06:33:54.974267 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:54.974268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:54.974278 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:54.974335 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:54.975235 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.976081 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.977045 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.977226 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.977276 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:54.979599 (+ 2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:54.979600 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:54.979601 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:54.979608 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:54.981211 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:54.981642 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:54.981643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:54.981644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:54.981701 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:54.981967 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:54.981968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:54.981968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:54.982090 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:54.982161 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:54.982455 (+ 294us) server_negotiation.cc:299] Negotiation successful
0929 06:33:54.982534 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 06:33:54.982821 12342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:54.973485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38825 (local address 127.9.61.67:51977)
0929 06:33:54.973670 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:54.973712 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:54.974186 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:54.974389 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:54.974394 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:54.974959 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:54.975151 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:54.975156 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.976159 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.976160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:54.976970 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:54.976972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:54.977309 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:54.977310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:54.977455 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:54.977922 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:54.977930 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:54.979494 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:54.981313 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:54.981319 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:54.981322 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:54.981552 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:54.981785 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:54.981785 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:54.981786 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:54.981898 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:54.982166 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:54.982172 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:54.982311 (+ 139us) client_negotiation.cc:769] Sending connection context
0929 06:33:54.982423 (+ 112us) client_negotiation.cc:240] Negotiation successful
0929 06:33:54.982581 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":95,"threads_started":1}
I20260929 06:33:54.983311 12340 heartbeater.cc:347] Connected to a master server at 127.9.61.126:38825
I20260929 06:33:54.983424 12340 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:54.983634 12340 heartbeater.cc:511] Master 127.9.61.126:38825 requested a full tablet report, sending...
I20260929 06:33:54.984050 11881 ts_manager.cc:194] Registered new tserver with Master: 24ce3e24481e48c1817568eab964484e (127.9.61.67:41343)
I20260929 06:33:54.984489 11881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:51977
I20260929 06:33:54.991811 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260929 06:33:55.002784 11921 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:33:55.001927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48702 (local address 127.9.61.126:38825)
0929 06:33:55.002026 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:55.002028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:55.002093 (+ 65us) server_negotiation.cc:407] Connection header received
0929 06:33:55.002141 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:55.002142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:55.002151 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:55.002215 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:55.002703 (+ 488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48702: BlockingRecv error: recv got EOF from 127.0.0.1:48702 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260929 06:33:55.003620 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 11943
I20260929 06:33:55.008121 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 12077
I20260929 06:33:55.012404 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 12211
I20260929 06:33:55.016453 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 11849
2026-09-29T06:33:55Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1827 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:33:55 dist-test-slave-601b krb5kdc[12352](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:33:55 dist-test-slave-601b krb5kdc[12352](info): set up 2 sockets
Sep 29 06:33:55 dist-test-slave-601b krb5kdc[12352](info): commencing operation
krb5kdc: starting...
W20260929 06:33:56.055821 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:33:56 dist-test-slave-601b krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:33:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:33:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:33:56.170982 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:35325
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:45805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:35325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:56.252487 12365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:56.252683 12365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:56.252704 12365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:56.253824 12365 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:33:56.253865 12365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:56.253880 12365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:56.253891 12365 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:33:56.253938 12365 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:33:56.255650 12365 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:45805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:35325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:35325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:56.255914 12365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:56.256210 12365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:56.261227 12373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:56.261231 12371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:56.261272 12370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:56.261503 12365 server_base.cc:1034] running on GCE node
I20260929 06:33:56.261837 12365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:56.262189 12365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:56.263414 12365 hybrid_clock.cc:648] HybridClock initialized: now 1790663636263415 us; error 46 us; skew 500 ppm
Sep 29 06:33:56 dist-test-slave-601b krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663636, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:56.266247 12365 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:33:56.266722 12365 webserver.cc:460] Webserver started at http://127.9.61.126:35869/ using document root <none> and password file <none>
I20260929 06:33:56.266953 12365 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:56.267021 12365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:56.267174 12365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:56.268303 12365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "6851f9f365e54306b7a2cc8c77dc4a57"
format_stamp: "Formatted at 2026-09-29 06:33:56 on dist-test-slave-601b"
server_key: "4eeda57e8c2c364f69306ed0f78909f3"
server_key_iv: "070afaaac58bc17ea97b045a6fdcad7d"
server_key_version: "encryptionkey@0"
I20260929 06:33:56.268683 12365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "6851f9f365e54306b7a2cc8c77dc4a57"
format_stamp: "Formatted at 2026-09-29 06:33:56 on dist-test-slave-601b"
server_key: "4eeda57e8c2c364f69306ed0f78909f3"
server_key_iv: "070afaaac58bc17ea97b045a6fdcad7d"
server_key_version: "encryptionkey@0"
I20260929 06:33:56.270283 12365 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:33:56.271129 12380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:56.271363 12365 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:56.271474 12365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "6851f9f365e54306b7a2cc8c77dc4a57"
format_stamp: "Formatted at 2026-09-29 06:33:56 on dist-test-slave-601b"
server_key: "4eeda57e8c2c364f69306ed0f78909f3"
server_key_iv: "070afaaac58bc17ea97b045a6fdcad7d"
server_key_version: "encryptionkey@0"
I20260929 06:33:56.271561 12365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:56.313370 12365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:56.315871 12365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:56.316107 12365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:56.320429 12365 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:35325
I20260929 06:33:56.320559 12432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:35325 every 8 connection(s)
I20260929 06:33:56.320878 12365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:33:56.321745 12433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:56.324038 12433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57: Bootstrap starting.
I20260929 06:33:56.324580 12433 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:56.324817 12433 log.cc:824] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:56.325474 12433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57: No bootstrap required, opened a new log
I20260929 06:33:56.326203 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 12365
I20260929 06:33:56.326315 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:33:56.326531 9461 external_mini_cluster.cc:1428] Setting key 64c78f54a6061c65431a44fadda323d9
I20260929 06:33:56.328243 12433 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6851f9f365e54306b7a2cc8c77dc4a57" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 35325 } }
I20260929 06:33:56.328437 12433 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:56.328516 12433 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6851f9f365e54306b7a2cc8c77dc4a57, State: Initialized, Role: FOLLOWER
I20260929 06:33:56.328665 12433 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6851f9f365e54306b7a2cc8c77dc4a57" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 35325 } }
I20260929 06:33:56.328775 12433 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:33:56.328822 12433 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:33:56.328873 12433 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:56.329592 12433 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6851f9f365e54306b7a2cc8c77dc4a57" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 35325 } }
I20260929 06:33:56.329698 12433 leader_election.cc:302] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6851f9f365e54306b7a2cc8c77dc4a57; no voters:
I20260929 06:33:56.329874 12433 leader_election.cc:288] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:33:56.329959 12438 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:56.330114 12433 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:33:56.330214 12438 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [term 1 LEADER]: Becoming Leader. State: Replica: 6851f9f365e54306b7a2cc8c77dc4a57, State: Running, Role: LEADER
I20260929 06:33:56.330304 12438 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6851f9f365e54306b7a2cc8c77dc4a57" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 35325 } }
I20260929 06:33:56.330613 12438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6851f9f365e54306b7a2cc8c77dc4a57. Latest consensus state: current_term: 1 leader_uuid: "6851f9f365e54306b7a2cc8c77dc4a57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6851f9f365e54306b7a2cc8c77dc4a57" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 35325 } } }
I20260929 06:33:56.330737 12438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [sys.catalog]: This master's current role is: LEADER
I20260929 06:33:56.330711 12439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6851f9f365e54306b7a2cc8c77dc4a57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6851f9f365e54306b7a2cc8c77dc4a57" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 35325 } } }
I20260929 06:33:56.330910 12439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57 [sys.catalog]: This master's current role is: LEADER
W20260929 06:33:56.332047 12453 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:33:56.332144 12453 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:33:56.332242 12446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:33:56.332408 12446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:33:56.333956 12446 catalog_manager.cc:1347] Generated new cluster ID: a2c73dff27b740819ad8a5d5892ac1ae
I20260929 06:33:56.334007 12446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:33:56 dist-test-slave-601b krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:56.339437 12437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:56.327065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37034 (local address 127.9.61.126:35325)
0929 06:33:56.327283 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:56.327294 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:56.327337 (+ 43us) server_negotiation.cc:407] Connection header received
0929 06:33:56.328201 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:56.328211 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:56.328282 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:56.328451 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:56.329255 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:56.330737 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:56.331873 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:56.332538 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:56.332643 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:56.335594 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:56.335599 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:56.335599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:56.335612 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:56.337684 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:56.338090 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:56.338094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:56.338094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:56.338224 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:56.338439 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:56.338440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:56.338440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:56.338770 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:56.338986 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:56.339071 (+ 85us) server_negotiation.cc:299] Negotiation successful
0929 06:33:56.339230 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":91,"threads_started":1}
I20260929 06:33:56.344945 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:33:56.360002 12446 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:33:56.360810 12446 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:33:56.365772 12437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:56.361415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37048 (local address 127.9.61.126:35325)
0929 06:33:56.361461 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:56.361463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:56.361620 (+ 157us) server_negotiation.cc:407] Connection header received
0929 06:33:56.361674 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:56.361675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:56.361699 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:56.361756 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:56.362170 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:56.362975 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:56.364087 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:56.364438 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:56.364506 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:56.365262 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:56.365264 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:56.365265 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:33:56.365503 (+ 238us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:56.365522 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:33:56.365530 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:56.365593 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:56.365653 (+ 60us) server_negotiation.cc:299] Negotiation successful
0929 06:33:56.365679 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:33:56.378198 12446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6851f9f365e54306b7a2cc8c77dc4a57: Generated new TSK 0
I20260929 06:33:56.378423 12446 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:33:56.381382 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 12365
2026-09-29T06:33:56Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1362 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:33:56 dist-test-slave-601b krb5kdc[12466](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:33:56 dist-test-slave-601b krb5kdc[12466](info): set up 2 sockets
Sep 29 06:33:56 dist-test-slave-601b krb5kdc[12466](info): commencing operation
krb5kdc: starting...
W20260929 06:33:57.403795 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.004s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:33:57 dist-test-slave-601b krb5kdc[12466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:33:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:33:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:33:57.522572 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:37775
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:37775
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:57.601105 12479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:57.601305 12479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:57.601325 12479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:57.602483 12479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:33:57.602525 12479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:57.602540 12479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:57.602598 12479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:33:57.602625 12479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:33:57.604125 12479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:37775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:37775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:57.604383 12479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:57.604611 12479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:57.609324 12487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:57.609336 12484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:57.609335 12485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:57.609558 12479 server_base.cc:1034] running on GCE node
I20260929 06:33:57.609872 12479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:57.610186 12479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:57.611349 12479 hybrid_clock.cc:648] HybridClock initialized: now 1790663637611356 us; error 53 us; skew 500 ppm
Sep 29 06:33:57 dist-test-slave-601b krb5kdc[12466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663637, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:57.617933 12479 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:33:57.618361 12479 webserver.cc:460] Webserver started at http://127.9.61.126:39293/ using document root <none> and password file <none>
I20260929 06:33:57.618609 12479 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:57.618676 12479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:57.618824 12479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:57.619871 12479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "f7a9efcbadc84a6c933c9a5ec5f55325"
format_stamp: "Formatted at 2026-09-29 06:33:57 on dist-test-slave-601b"
server_key: "c2ba415f44bcf1582424655908081852"
server_key_iv: "59d58cf45df6b59ab88a182d3f5bdc2a"
server_key_version: "encryptionkey@0"
I20260929 06:33:57.620299 12479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "f7a9efcbadc84a6c933c9a5ec5f55325"
format_stamp: "Formatted at 2026-09-29 06:33:57 on dist-test-slave-601b"
server_key: "c2ba415f44bcf1582424655908081852"
server_key_iv: "59d58cf45df6b59ab88a182d3f5bdc2a"
server_key_version: "encryptionkey@0"
I20260929 06:33:57.621668 12479 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:33:57.622402 12494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:57.622586 12479 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:57.622675 12479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "f7a9efcbadc84a6c933c9a5ec5f55325"
format_stamp: "Formatted at 2026-09-29 06:33:57 on dist-test-slave-601b"
server_key: "c2ba415f44bcf1582424655908081852"
server_key_iv: "59d58cf45df6b59ab88a182d3f5bdc2a"
server_key_version: "encryptionkey@0"
I20260929 06:33:57.622756 12479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:57.637013 12479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:57.638805 12479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:57.638965 12479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:57.643110 12479 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:37775
I20260929 06:33:57.643159 12546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:37775 every 8 connection(s)
I20260929 06:33:57.643554 12479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:33:57.644604 12547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:57.646823 12547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325: Bootstrap starting.
I20260929 06:33:57.647071 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 12479
I20260929 06:33:57.647179 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:33:57.647357 9461 external_mini_cluster.cc:1428] Setting key e8906b756e96db720e0e4f7322223278
I20260929 06:33:57.647513 12547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:57.647848 12547 log.cc:824] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:57.648609 12547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325: No bootstrap required, opened a new log
I20260929 06:33:57.650859 12547 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7a9efcbadc84a6c933c9a5ec5f55325" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37775 } }
I20260929 06:33:57.651032 12547 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:57.651073 12547 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7a9efcbadc84a6c933c9a5ec5f55325, State: Initialized, Role: FOLLOWER
I20260929 06:33:57.651202 12547 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7a9efcbadc84a6c933c9a5ec5f55325" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37775 } }
I20260929 06:33:57.651273 12547 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:33:57.651324 12547 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:33:57.651376 12547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:57.651957 12547 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7a9efcbadc84a6c933c9a5ec5f55325" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37775 } }
I20260929 06:33:57.652056 12547 leader_election.cc:302] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7a9efcbadc84a6c933c9a5ec5f55325; no voters:
I20260929 06:33:57.652202 12547 leader_election.cc:288] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:33:57.652254 12552 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:57.652422 12552 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [term 1 LEADER]: Becoming Leader. State: Replica: f7a9efcbadc84a6c933c9a5ec5f55325, State: Running, Role: LEADER
I20260929 06:33:57.652439 12547 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:33:57.652572 12552 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7a9efcbadc84a6c933c9a5ec5f55325" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37775 } }
I20260929 06:33:57.652896 12553 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7a9efcbadc84a6c933c9a5ec5f55325" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7a9efcbadc84a6c933c9a5ec5f55325" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37775 } } }
I20260929 06:33:57.652964 12553 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [sys.catalog]: This master's current role is: LEADER
I20260929 06:33:57.653920 12557 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:33:57.654089 12554 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7a9efcbadc84a6c933c9a5ec5f55325. Latest consensus state: current_term: 1 leader_uuid: "f7a9efcbadc84a6c933c9a5ec5f55325" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7a9efcbadc84a6c933c9a5ec5f55325" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37775 } } }
I20260929 06:33:57.654171 12554 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325 [sys.catalog]: This master's current role is: LEADER
I20260929 06:33:57.654392 12557 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 29 06:33:57 dist-test-slave-601b krb5kdc[12466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:57.656520 12557 catalog_manager.cc:1347] Generated new cluster ID: f8e737ec6b114718900693267157b6a2
I20260929 06:33:57.656570 12557 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:33:57.660760 12550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:57.647840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49590 (local address 127.9.61.126:37775)
0929 06:33:57.648077 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:57.648086 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:57.648119 (+ 33us) server_negotiation.cc:407] Connection header received
0929 06:33:57.648683 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:57.648691 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:57.648762 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:57.648914 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:57.649500 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:57.650929 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:57.651858 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:57.652518 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:57.652928 (+ 410us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:57.655424 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:57.655428 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:57.655428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:57.655441 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:57.659078 (+ 3637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:57.659463 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:57.659467 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:57.659467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:57.659579 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:57.659787 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:57.659788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:57.659788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:57.660122 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:57.660304 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:57.660386 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 06:33:57.660534 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":119,"threads_started":1}
I20260929 06:33:57.673565 12557 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:33:57.674075 12557 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:33:57.679780 12557 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7a9efcbadc84a6c933c9a5ec5f55325: Generated new TSK 0
I20260929 06:33:57.680018 12557 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:33:57.708161 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37775
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:57.802928 12573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:57.803196 12573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:57.803220 12573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:57.804489 12573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:57.804533 12573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:57.804560 12573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:33:57.806097 12573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12573
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:57.806326 12573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:57.806565 12573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:57.811473 12578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:57.811444 12581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:57.811440 12579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:57.811691 12573 server_base.cc:1034] running on GCE node
I20260929 06:33:57.811896 12573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:57.812160 12573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:57.813314 12573 hybrid_clock.cc:648] HybridClock initialized: now 1790663637813312 us; error 34 us; skew 500 ppm
Sep 29 06:33:57 dist-test-slave-601b krb5kdc[12466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663637, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:57.815698 12573 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:33:57.816174 12573 webserver.cc:460] Webserver started at http://127.9.61.65:40315/ using document root <none> and password file <none>
I20260929 06:33:57.816401 12573 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:57.816470 12573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:57.816632 12573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:57.817673 12573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "c2d89182581a475e9b67c05287376906"
format_stamp: "Formatted at 2026-09-29 06:33:57 on dist-test-slave-601b"
server_key: "c88fb08cc2c609b4eeaee8728268287e"
server_key_iv: "6e07866181da6181d2f65c4ca7115d0b"
server_key_version: "encryptionkey@0"
I20260929 06:33:57.818038 12573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "c2d89182581a475e9b67c05287376906"
format_stamp: "Formatted at 2026-09-29 06:33:57 on dist-test-slave-601b"
server_key: "c88fb08cc2c609b4eeaee8728268287e"
server_key_iv: "6e07866181da6181d2f65c4ca7115d0b"
server_key_version: "encryptionkey@0"
I20260929 06:33:57.819408 12573 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:33:57.820143 12588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:57.820313 12573 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:57.820417 12573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "c2d89182581a475e9b67c05287376906"
format_stamp: "Formatted at 2026-09-29 06:33:57 on dist-test-slave-601b"
server_key: "c88fb08cc2c609b4eeaee8728268287e"
server_key_iv: "6e07866181da6181d2f65c4ca7115d0b"
server_key_version: "encryptionkey@0"
I20260929 06:33:57.820492 12573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:57.838685 12573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:57.840788 12573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:57.840953 12573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:57.841188 12573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:57.841507 12573 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:57.841563 12573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:57.841603 12573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:57.841630 12573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:57.847290 12573 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:34117
I20260929 06:33:57.847361 12701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:34117 every 8 connection(s)
I20260929 06:33:57.847690 12573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:33:57.853763 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 12573
I20260929 06:33:57.853880 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
Sep 29 06:33:57 dist-test-slave-601b krb5kdc[12466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663637, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:57.854147 9461 external_mini_cluster.cc:1428] Setting key e2a59aa6e8ec239ec484c258a8420254
I20260929 06:33:57.857599 12550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:57.848482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:49897 (local address 127.9.61.126:37775)
0929 06:33:57.848544 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:57.848545 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:57.848746 (+ 201us) server_negotiation.cc:407] Connection header received
0929 06:33:57.849218 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:57.849219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:57.849228 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:57.849296 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:57.850231 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:57.850743 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:57.851720 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:57.851922 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:57.852045 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:57.854543 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:57.854544 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:57.854545 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:57.854552 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:57.856159 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:57.856678 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:57.856679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:57.856679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:57.856729 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:57.857007 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:57.857007 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:57.857008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:57.857103 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:57.857152 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:57.857473 (+ 321us) server_negotiation.cc:299] Negotiation successful
0929 06:33:57.857537 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 06:33:57.857921 12704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:57.848449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37775 (local address 127.9.61.65:49897)
0929 06:33:57.848608 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:57.848650 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:57.849135 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:57.849351 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:57.849354 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:57.849928 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:57.850121 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:57.850126 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:57.850828 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:57.850828 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:57.851629 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:57.851631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:57.852067 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:57.852068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:57.852167 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:57.852765 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:57.852773 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:57.854441 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:57.856238 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:57.856246 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:57.856248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:57.856601 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:57.856795 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:57.856796 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:57.856796 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:57.856943 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:57.857165 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:57.857170 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:57.857333 (+ 163us) client_negotiation.cc:769] Sending connection context
0929 06:33:57.857462 (+ 129us) client_negotiation.cc:240] Negotiation successful
0929 06:33:57.857639 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":86,"threads_started":1}
I20260929 06:33:57.858505 12702 heartbeater.cc:347] Connected to a master server at 127.9.61.126:37775
I20260929 06:33:57.858614 12702 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:57.858784 12702 heartbeater.cc:511] Master 127.9.61.126:37775 requested a full tablet report, sending...
I20260929 06:33:57.859335 12511 ts_manager.cc:194] Registered new tserver with Master: c2d89182581a475e9b67c05287376906 (127.9.61.65:34117)
I20260929 06:33:57.859925 12511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:49897
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:33:57.878674 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37775
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:57.958329 12707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:57.958534 12707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:57.958557 12707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:57.959774 12707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:57.959820 12707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:57.959846 12707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:33:57.961287 12707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:57.961527 12707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:57.961751 12707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:57.966661 12713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:57.966775 12715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:57.966801 12707 server_base.cc:1034] running on GCE node
W20260929 06:33:57.966665 12712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:57.967054 12707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:57.967285 12707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:57.968442 12707 hybrid_clock.cc:648] HybridClock initialized: now 1790663637968436 us; error 40 us; skew 500 ppm
Sep 29 06:33:57 dist-test-slave-601b krb5kdc[12466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663637, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:57.970793 12707 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:33:57.971218 12707 webserver.cc:460] Webserver started at http://127.9.61.66:39753/ using document root <none> and password file <none>
I20260929 06:33:57.971480 12707 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:57.971551 12707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:57.971700 12707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:57.972807 12707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "81952cc672084130abeded77ded8daa5"
format_stamp: "Formatted at 2026-09-29 06:33:57 on dist-test-slave-601b"
server_key: "3e9f1c9e54cac31a6c4fe5af4da2b5a7"
server_key_iv: "2c4510bb25fee901c9110d255cd0cc84"
server_key_version: "encryptionkey@0"
I20260929 06:33:57.973156 12707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "81952cc672084130abeded77ded8daa5"
format_stamp: "Formatted at 2026-09-29 06:33:57 on dist-test-slave-601b"
server_key: "3e9f1c9e54cac31a6c4fe5af4da2b5a7"
server_key_iv: "2c4510bb25fee901c9110d255cd0cc84"
server_key_version: "encryptionkey@0"
I20260929 06:33:57.974439 12707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:33:57.975270 12722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:57.975468 12707 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:33:57.975564 12707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "81952cc672084130abeded77ded8daa5"
format_stamp: "Formatted at 2026-09-29 06:33:57 on dist-test-slave-601b"
server_key: "3e9f1c9e54cac31a6c4fe5af4da2b5a7"
server_key_iv: "2c4510bb25fee901c9110d255cd0cc84"
server_key_version: "encryptionkey@0"
I20260929 06:33:57.975648 12707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:57.990231 12707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:57.992161 12707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:57.992316 12707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:57.992558 12707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:57.992873 12707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:57.992926 12707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:57.992970 12707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:57.992998 12707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:58.000511 12707 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:40261
I20260929 06:33:58.000579 12835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:40261 every 8 connection(s)
I20260929 06:33:58.000936 12707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:33:58.003253 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 12707
I20260929 06:33:58.003413 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:33:58.003633 9461 external_mini_cluster.cc:1428] Setting key 14b536b47ee0e9304665cf8567889f8d
Sep 29 06:33:58 dist-test-slave-601b krb5kdc[12466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663637, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
I20260929 06:33:58.012415 12550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:58.001990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:53445 (local address 127.9.61.126:37775)
0929 06:33:58.002036 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:58.002038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:58.002899 (+ 861us) server_negotiation.cc:407] Connection header received
0929 06:33:58.003634 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:58.003635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:58.003650 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:58.003726 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:58.004767 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:58.005543 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:58.006682 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:58.007007 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:58.007082 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:58.009599 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:58.009600 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:58.009601 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:58.009609 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:58.010978 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:58.011390 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:58.011391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:58.011392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:58.011452 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:58.011700 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:58.011701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:58.011701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:58.011814 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:58.011922 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:58.012237 (+ 315us) server_negotiation.cc:299] Negotiation successful
0929 06:33:58.012321 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:33:58.012612 12838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:58.001665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37775 (local address 127.9.61.66:53445)
0929 06:33:58.002749 (+ 1084us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:58.002798 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:58.003514 (+ 716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:58.003814 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:58.003818 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:58.004467 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:58.004663 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:58.004668 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:58.005664 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:58.005665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:58.006601 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:58.006604 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:58.007114 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:58.007115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:58.007291 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:58.007825 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:58.007837 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:58.009502 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:58.011063 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:58.011069 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:58.011072 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:58.011294 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:58.011521 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:58.011522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:58.011522 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:58.011634 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:58.011915 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:58.011920 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:58.012085 (+ 165us) client_negotiation.cc:769] Sending connection context
0929 06:33:58.012202 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 06:33:58.012375 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1035,"thread_start_us":115,"threads_started":1}
I20260929 06:33:58.013019 12836 heartbeater.cc:347] Connected to a master server at 127.9.61.126:37775
I20260929 06:33:58.013167 12836 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:58.013371 12836 heartbeater.cc:511] Master 127.9.61.126:37775 requested a full tablet report, sending...
I20260929 06:33:58.013703 12511 ts_manager.cc:194] Registered new tserver with Master: 81952cc672084130abeded77ded8daa5 (127.9.61.66:40261)
I20260929 06:33:58.014125 12511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:53445
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:33:58.030079 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37775
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:58.110800 12841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:58.110996 12841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:58.111017 12841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:58.112113 12841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:58.112146 12841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:58.112171 12841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:33:58.113521 12841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:58.113703 12841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:58.113863 12841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:58.118645 12849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:58.118675 12841 server_base.cc:1034] running on GCE node
W20260929 06:33:58.118688 12846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:58.118649 12847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:58.119012 12841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:58.119237 12841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:58.120393 12841 hybrid_clock.cc:648] HybridClock initialized: now 1790663638120371 us; error 34 us; skew 500 ppm
Sep 29 06:33:58 dist-test-slave-601b krb5kdc[12466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663638, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:58.122804 12841 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:33:58.123359 12841 webserver.cc:460] Webserver started at http://127.9.61.67:43237/ using document root <none> and password file <none>
I20260929 06:33:58.123611 12841 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:58.123656 12841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:58.123801 12841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:58.124965 12841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "bd72af93dcbb4527b04d78efe36a55f1"
format_stamp: "Formatted at 2026-09-29 06:33:58 on dist-test-slave-601b"
server_key: "bc93c4cba58f321ceb327025ebe39324"
server_key_iv: "d28afd3a5bb2038370103c4a35c0b921"
server_key_version: "encryptionkey@0"
I20260929 06:33:58.125327 12841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "bd72af93dcbb4527b04d78efe36a55f1"
format_stamp: "Formatted at 2026-09-29 06:33:58 on dist-test-slave-601b"
server_key: "bc93c4cba58f321ceb327025ebe39324"
server_key_iv: "d28afd3a5bb2038370103c4a35c0b921"
server_key_version: "encryptionkey@0"
I20260929 06:33:58.126662 12841 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:33:58.127345 12856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:58.127521 12841 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:58.127619 12841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "bd72af93dcbb4527b04d78efe36a55f1"
format_stamp: "Formatted at 2026-09-29 06:33:58 on dist-test-slave-601b"
server_key: "bc93c4cba58f321ceb327025ebe39324"
server_key_iv: "d28afd3a5bb2038370103c4a35c0b921"
server_key_version: "encryptionkey@0"
I20260929 06:33:58.127693 12841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:58.146860 12841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:58.148826 12841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:58.148988 12841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:58.149235 12841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:58.149560 12841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:58.149616 12841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:58.149659 12841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:58.149688 12841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:58.156001 12841 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:42537
I20260929 06:33:58.156039 12969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:42537 every 8 connection(s)
I20260929 06:33:58.156368 12841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:33:58 dist-test-slave-601b krb5kdc[12466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663638, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:58.164937 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 12841
I20260929 06:33:58.165067 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:33:58.165299 9461 external_mini_cluster.cc:1428] Setting key 96b9eee18fa51836c1185a0fc1c9b90e
I20260929 06:33:58.165599 12550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:58.157071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:42527 (local address 127.9.61.126:37775)
0929 06:33:58.157130 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:58.157132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:58.157360 (+ 228us) server_negotiation.cc:407] Connection header received
0929 06:33:58.157820 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:58.157821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:58.157830 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:58.157893 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:58.158775 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:58.159367 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:58.160431 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:58.160650 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:58.160704 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:58.162744 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:58.162745 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:58.162745 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:58.162752 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:58.164205 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:58.164644 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:58.164646 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:58.164646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:58.164706 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:58.164957 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:58.164958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:58.164958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:58.165094 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:58.165159 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:58.165427 (+ 268us) server_negotiation.cc:299] Negotiation successful
0929 06:33:58.165503 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 06:33:58.165838 12972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:58.157067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37775 (local address 127.9.61.67:42527)
0929 06:33:58.157224 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:58.157264 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:58.157740 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:58.157945 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:58.157948 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:58.158507 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:58.158701 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:58.158706 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:58.159448 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:58.159449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:58.160359 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:58.160361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:58.160738 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:58.160739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:58.160891 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:58.161352 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:58.161360 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:58.162657 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:58.164321 (+ 1664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:58.164327 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:58.164329 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:58.164563 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:58.164774 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:58.164775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:58.164776 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:58.164886 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:58.165149 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:58.165155 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:58.165295 (+ 140us) client_negotiation.cc:769] Sending connection context
0929 06:33:58.165404 (+ 109us) client_negotiation.cc:240] Negotiation successful
0929 06:33:58.165576 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
I20260929 06:33:58.166505 12970 heartbeater.cc:347] Connected to a master server at 127.9.61.126:37775
I20260929 06:33:58.166596 12970 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:58.166730 12970 heartbeater.cc:511] Master 127.9.61.126:37775 requested a full tablet report, sending...
I20260929 06:33:58.167104 12511 ts_manager.cc:194] Registered new tserver with Master: bd72af93dcbb4527b04d78efe36a55f1 (127.9.61.67:42537)
I20260929 06:33:58.167488 12511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:42527
I20260929 06:33:58.177341 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 06:33:58 dist-test-slave-601b krb5kdc[12466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663638, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Sep 29 06:33:58 dist-test-slave-601b krb5kdc[12466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663638, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:58.200529 12550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:58.193161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49600 (local address 127.9.61.126:37775)
0929 06:33:58.193239 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:58.193241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:58.193344 (+ 103us) server_negotiation.cc:407] Connection header received
0929 06:33:58.193469 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:58.193470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:58.193481 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:58.193558 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:58.194164 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:58.194673 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:58.195445 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:58.195638 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:58.195726 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:58.198221 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:58.198224 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:58.198224 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:58.198235 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:58.199494 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:58.199792 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:58.199793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:58.199794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:58.199842 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:58.200056 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:58.200057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:58.200057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:58.200198 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:58.200277 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:58.200361 (+ 84us) server_negotiation.cc:299] Negotiation successful
0929 06:33:58.200433 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260929 06:33:58.200821 12511 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:49600
I20260929 06:33:58.201335 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 12573
I20260929 06:33:58.206126 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 12707
I20260929 06:33:58.210471 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 12841
I20260929 06:33:58.214578 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 12479
2026-09-29T06:33:58Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1834 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:33:58 dist-test-slave-601b krb5kdc[12982](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:33:58 dist-test-slave-601b krb5kdc[12982](info): set up 2 sockets
Sep 29 06:33:58 dist-test-slave-601b krb5kdc[12982](info): commencing operation
krb5kdc: starting...
W20260929 06:33:59.247816 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:33:59 dist-test-slave-601b krb5kdc[12982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:33:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:33:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:33:59.367046 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41415
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:40077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:41415
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:59.446983 12995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:59.447196 12995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:59.447218 12995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:59.448381 12995 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:33:59.448421 12995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:59.448434 12995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:59.448446 12995 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:33:59.448499 12995 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:33:59.449949 12995 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:40077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:41415
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:59.450230 12995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:59.450464 12995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:59.455183 13000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:59.455287 12995 server_base.cc:1034] running on GCE node
W20260929 06:33:59.455304 13001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:59.455317 13003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:59.455708 12995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:59.456004 12995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:59.457158 12995 hybrid_clock.cc:648] HybridClock initialized: now 1790663639457133 us; error 45 us; skew 500 ppm
Sep 29 06:33:59 dist-test-slave-601b krb5kdc[12982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663639, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:59.459558 12995 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:33:59.459928 12995 webserver.cc:460] Webserver started at http://127.9.61.126:39537/ using document root <none> and password file <none>
I20260929 06:33:59.460186 12995 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:59.460227 12995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:59.460318 12995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:59.461261 12995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "03f65b520e844131a17ed9d6ecef6928"
format_stamp: "Formatted at 2026-09-29 06:33:59 on dist-test-slave-601b"
server_key: "427c00b7c02d99ebba95a22bc77be60e"
server_key_iv: "29c9e42e6f11ea631d2c86755d16b626"
server_key_version: "encryptionkey@0"
I20260929 06:33:59.461565 12995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "03f65b520e844131a17ed9d6ecef6928"
format_stamp: "Formatted at 2026-09-29 06:33:59 on dist-test-slave-601b"
server_key: "427c00b7c02d99ebba95a22bc77be60e"
server_key_iv: "29c9e42e6f11ea631d2c86755d16b626"
server_key_version: "encryptionkey@0"
I20260929 06:33:59.462905 12995 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:33:59.463588 13010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:59.463768 12995 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:33:59.463876 12995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "03f65b520e844131a17ed9d6ecef6928"
format_stamp: "Formatted at 2026-09-29 06:33:59 on dist-test-slave-601b"
server_key: "427c00b7c02d99ebba95a22bc77be60e"
server_key_iv: "29c9e42e6f11ea631d2c86755d16b626"
server_key_version: "encryptionkey@0"
I20260929 06:33:59.463968 12995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:59.473739 12995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:59.475453 12995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:59.475605 12995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:59.479635 12995 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:41415
I20260929 06:33:59.479743 13062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:41415 every 8 connection(s)
I20260929 06:33:59.480259 12995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:33:59.480942 13063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:33:59.481487 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 12995
I20260929 06:33:59.481607 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:33:59.481775 9461 external_mini_cluster.cc:1428] Setting key 68562a9dea07b3c190bf8801ed51cc24
I20260929 06:33:59.483847 13063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928: Bootstrap starting.
I20260929 06:33:59.484576 13063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928: Neither blocks nor log segments found. Creating new log.
I20260929 06:33:59.484876 13063 log.cc:824] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928: Log is configured to *not* fsync() on all Append() calls
I20260929 06:33:59.485569 13063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928: No bootstrap required, opened a new log
I20260929 06:33:59.487718 13063 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f65b520e844131a17ed9d6ecef6928" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41415 } }
I20260929 06:33:59.487859 13063 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:33:59.487881 13063 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f65b520e844131a17ed9d6ecef6928, State: Initialized, Role: FOLLOWER
I20260929 06:33:59.488045 13063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f65b520e844131a17ed9d6ecef6928" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41415 } }
I20260929 06:33:59.488125 13063 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:33:59.488166 13063 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:33:59.488217 13063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:33:59.488709 13063 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f65b520e844131a17ed9d6ecef6928" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41415 } }
Sep 29 06:33:59 dist-test-slave-601b krb5kdc[12982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:59.488831 13063 leader_election.cc:302] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03f65b520e844131a17ed9d6ecef6928; no voters:
I20260929 06:33:59.488999 13063 leader_election.cc:288] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:33:59.489032 13068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:33:59.489143 13068 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [term 1 LEADER]: Becoming Leader. State: Replica: 03f65b520e844131a17ed9d6ecef6928, State: Running, Role: LEADER
I20260929 06:33:59.489254 13063 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:33:59.489236 13068 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f65b520e844131a17ed9d6ecef6928" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41415 } }
I20260929 06:33:59.489588 13068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03f65b520e844131a17ed9d6ecef6928" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f65b520e844131a17ed9d6ecef6928" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41415 } } }
I20260929 06:33:59.489691 13068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [sys.catalog]: This master's current role is: LEADER
I20260929 06:33:59.489827 13068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03f65b520e844131a17ed9d6ecef6928. Latest consensus state: current_term: 1 leader_uuid: "03f65b520e844131a17ed9d6ecef6928" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f65b520e844131a17ed9d6ecef6928" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41415 } } }
I20260929 06:33:59.489893 13068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928 [sys.catalog]: This master's current role is: LEADER
I20260929 06:33:59.490048 13074 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:33:59.490747 13074 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:33:59.492218 13074 catalog_manager.cc:1347] Generated new cluster ID: 9868996e05d543f7834917e6ace1a9c7
I20260929 06:33:59.492270 13074 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:33:59.492929 13066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:59.482303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44928 (local address 127.9.61.126:41415)
0929 06:33:59.482495 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:59.482505 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:59.482537 (+ 32us) server_negotiation.cc:407] Connection header received
0929 06:33:59.483101 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:59.483110 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:59.483190 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:59.483346 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:59.483968 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:59.485321 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:59.486092 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:59.486744 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:59.486849 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:59.489378 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:59.489382 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:59.489382 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:59.489394 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:59.491275 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:59.491694 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:59.491697 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:59.491698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:59.491812 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:59.492028 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:59.492029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:59.492029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:59.492374 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:59.492528 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:59.492637 (+ 109us) server_negotiation.cc:299] Negotiation successful
0929 06:33:59.492768 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":76,"threads_started":1}
I20260929 06:33:59.508517 13074 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:33:59.509271 13074 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:33:59.515026 13074 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03f65b520e844131a17ed9d6ecef6928: Generated new TSK 0
I20260929 06:33:59.515223 13074 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:33:59.544539 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41415
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:40077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:59.624879 13089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:59.625115 13089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:59.625152 13089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:59.626278 13089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:59.626348 13089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:59.626392 13089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:33:59.627861 13089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:40077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:59.628157 13089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:59.628394 13089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:59.633471 13097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:59.633474 13094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:59.633554 13089 server_base.cc:1034] running on GCE node
W20260929 06:33:59.633481 13095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:59.633963 13089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:59.634178 13089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:59.635317 13089 hybrid_clock.cc:648] HybridClock initialized: now 1790663639635291 us; error 42 us; skew 500 ppm
Sep 29 06:33:59 dist-test-slave-601b krb5kdc[12982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663639, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:59.637766 13089 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:33:59.638221 13089 webserver.cc:460] Webserver started at http://127.9.61.65:44161/ using document root <none> and password file <none>
I20260929 06:33:59.638437 13089 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:59.638504 13089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:59.638649 13089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:59.639636 13089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "cb79938b6b15441094352c9e46b93474"
format_stamp: "Formatted at 2026-09-29 06:33:59 on dist-test-slave-601b"
server_key: "e01f3204d882e19851343def756f4966"
server_key_iv: "8ff9fea76c043294b0847918f61e9ea2"
server_key_version: "encryptionkey@0"
I20260929 06:33:59.640051 13089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "cb79938b6b15441094352c9e46b93474"
format_stamp: "Formatted at 2026-09-29 06:33:59 on dist-test-slave-601b"
server_key: "e01f3204d882e19851343def756f4966"
server_key_iv: "8ff9fea76c043294b0847918f61e9ea2"
server_key_version: "encryptionkey@0"
I20260929 06:33:59.641319 13089 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:33:59.642004 13104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:59.642307 13089 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:33:59.642407 13089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "cb79938b6b15441094352c9e46b93474"
format_stamp: "Formatted at 2026-09-29 06:33:59 on dist-test-slave-601b"
server_key: "e01f3204d882e19851343def756f4966"
server_key_iv: "8ff9fea76c043294b0847918f61e9ea2"
server_key_version: "encryptionkey@0"
I20260929 06:33:59.642498 13089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:59.666965 13089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:59.669426 13089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:59.669592 13089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:59.669847 13089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:59.670159 13089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:59.670213 13089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:59.670255 13089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:59.670280 13089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:59.676023 13089 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:40905
I20260929 06:33:59.676059 13217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:40905 every 8 connection(s)
I20260929 06:33:59.676436 13089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:33:59.679608 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 13089
I20260929 06:33:59.679740 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:33:59.679968 9461 external_mini_cluster.cc:1428] Setting key ca35182ef2a8cbb27b1e17c55f45634c
Sep 29 06:33:59 dist-test-slave-601b krb5kdc[12982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663639, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:59.686854 13066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:59.677195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:43501 (local address 127.9.61.126:41415)
0929 06:33:59.677242 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:59.677244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:59.677479 (+ 235us) server_negotiation.cc:407] Connection header received
0929 06:33:59.678407 (+ 928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:59.678408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:59.678418 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:59.678482 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:59.679117 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:59.679603 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:59.681142 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:59.681365 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:59.681422 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:59.683707 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:59.683709 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:59.683710 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:59.683718 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:59.685428 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:59.685834 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:59.685836 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:59.685837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:59.685902 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:59.686167 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:59.686168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:59.686169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:59.686311 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:59.686399 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:59.686647 (+ 248us) server_negotiation.cc:299] Negotiation successful
0929 06:33:59.686740 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:33:59.686892 13220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:59.677149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41415 (local address 127.9.61.65:43501)
0929 06:33:59.677347 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:59.677389 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:59.678310 (+ 921us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:59.678562 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:59.678566 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:59.678838 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:59.679039 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:59.679043 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:59.679710 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:59.679711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:59.681056 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:59.681059 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:59.681451 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:59.681452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:59.681602 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:59.682236 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:59.682244 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:59.683606 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:59.685524 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:59.685530 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:59.685531 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:59.685762 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:59.685973 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:59.685974 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:59.685974 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:59.686097 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:59.686395 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:59.686400 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:59.686511 (+ 111us) client_negotiation.cc:769] Sending connection context
0929 06:33:59.686594 (+ 83us) client_negotiation.cc:240] Negotiation successful
0929 06:33:59.686725 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":122,"threads_started":1}
I20260929 06:33:59.687448 13218 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41415
I20260929 06:33:59.687549 13218 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:59.687747 13218 heartbeater.cc:511] Master 127.9.61.126:41415 requested a full tablet report, sending...
I20260929 06:33:59.688468 13027 ts_manager.cc:194] Registered new tserver with Master: cb79938b6b15441094352c9e46b93474 (127.9.61.65:40905)
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
I20260929 06:33:59.689159 13027 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:43501
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:33:59.706543 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41415
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:40077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:59.791759 13223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:59.792043 13223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:59.792084 13223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:59.793241 13223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:59.793308 13223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:59.793351 13223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:33:59.794854 13223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:40077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:59.795130 13223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:59.795362 13223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:59.800278 13229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:59.800410 13223 server_base.cc:1034] running on GCE node
W20260929 06:33:59.800272 13231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:59.800308 13228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:59.800761 13223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:59.801002 13223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:59.802163 13223 hybrid_clock.cc:648] HybridClock initialized: now 1790663639802158 us; error 37 us; skew 500 ppm
Sep 29 06:33:59 dist-test-slave-601b krb5kdc[12982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663639, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:59.804656 13223 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:33:59.805095 13223 webserver.cc:460] Webserver started at http://127.9.61.66:34879/ using document root <none> and password file <none>
I20260929 06:33:59.805289 13223 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:59.805331 13223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:59.805418 13223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:59.806386 13223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "74fa2133c2f34010ab97faa491911c63"
format_stamp: "Formatted at 2026-09-29 06:33:59 on dist-test-slave-601b"
server_key: "a1e98fd038d8bf1c3e20167e508b3adf"
server_key_iv: "6f152290f6b7de451dc6520c59c56656"
server_key_version: "encryptionkey@0"
I20260929 06:33:59.806670 13223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "74fa2133c2f34010ab97faa491911c63"
format_stamp: "Formatted at 2026-09-29 06:33:59 on dist-test-slave-601b"
server_key: "a1e98fd038d8bf1c3e20167e508b3adf"
server_key_iv: "6f152290f6b7de451dc6520c59c56656"
server_key_version: "encryptionkey@0"
I20260929 06:33:59.807871 13223 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:33:59.808640 13238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:59.808807 13223 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:33:59.808887 13223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "74fa2133c2f34010ab97faa491911c63"
format_stamp: "Formatted at 2026-09-29 06:33:59 on dist-test-slave-601b"
server_key: "a1e98fd038d8bf1c3e20167e508b3adf"
server_key_iv: "6f152290f6b7de451dc6520c59c56656"
server_key_version: "encryptionkey@0"
I20260929 06:33:59.808939 13223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:59.835623 13223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:59.837579 13223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:59.837694 13223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:59.837881 13223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:59.838131 13223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:59.838161 13223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:59.838183 13223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:59.838196 13223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:59.844374 13223 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:41199
I20260929 06:33:59.844460 13351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:41199 every 8 connection(s)
I20260929 06:33:59.844784 13223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:33:59 dist-test-slave-601b krb5kdc[12982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663639, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:33:59.853324 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 13223
I20260929 06:33:59.853439 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:33:59.853609 9461 external_mini_cluster.cc:1428] Setting key 8bc3a5fa12f29536140a3c547aa110f5
I20260929 06:33:59.853790 13066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:59.845515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:53121 (local address 127.9.61.126:41415)
0929 06:33:59.845560 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:59.845562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:59.845755 (+ 193us) server_negotiation.cc:407] Connection header received
0929 06:33:59.846744 (+ 989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:33:59.846746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:33:59.846756 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:33:59.846810 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:33:59.847394 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:59.847879 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:59.848890 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:33:59.849072 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:33:59.849126 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:59.851122 (+ 1996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:33:59.851123 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:33:59.851123 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:33:59.851129 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:33:59.852440 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:59.852796 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:59.852797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:59.852797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:59.852843 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:33:59.853047 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:33:59.853048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:33:59.853048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:33:59.853140 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:33:59.853295 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0929 06:33:59.853619 (+ 324us) server_negotiation.cc:299] Negotiation successful
0929 06:33:59.853700 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:33:59.853989 13354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:59.845491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41415 (local address 127.9.61.66:53121)
0929 06:33:59.845653 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:59.845687 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:33:59.846646 (+ 959us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:33:59.846872 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:33:59.846875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:33:59.847125 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:33:59.847320 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:59.847325 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:59.848012 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:59.848013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:59.848804 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:33:59.848806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:33:59.849143 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:33:59.849144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:33:59.849246 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:33:59.849677 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:33:59.849685 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:33:59.851035 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:33:59.852514 (+ 1479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:59.852519 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:59.852521 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:59.852733 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:59.852901 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:33:59.852901 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:33:59.852902 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:33:59.852994 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:33:59.853291 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:33:59.853298 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:33:59.853462 (+ 164us) client_negotiation.cc:769] Sending connection context
0929 06:33:59.853587 (+ 125us) client_negotiation.cc:240] Negotiation successful
0929 06:33:59.853755 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":99,"threads_started":1}
I20260929 06:33:59.854513 13352 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41415
I20260929 06:33:59.854627 13352 heartbeater.cc:464] Registering TS with master...
I20260929 06:33:59.854806 13352 heartbeater.cc:511] Master 127.9.61.126:41415 requested a full tablet report, sending...
I20260929 06:33:59.855211 13027 ts_manager.cc:194] Registered new tserver with Master: 74fa2133c2f34010ab97faa491911c63 (127.9.61.66:41199)
I20260929 06:33:59.855582 13027 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:53121
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:33:59.878932 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41415
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:40077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:33:59.959968 13357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:33:59.960178 13357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:33:59.960201 13357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:33:59.961405 13357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:33:59.961452 13357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:33:59.961478 13357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:33:59.963203 13357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:40077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:33:59.963445 13357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:33:59.963698 13357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:33:59.968860 13362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:59.969046 13357 server_base.cc:1034] running on GCE node
W20260929 06:33:59.968829 13363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:33:59.968829 13365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:33:59.969374 13357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:33:59.969571 13357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:33:59.970718 13357 hybrid_clock.cc:648] HybridClock initialized: now 1790663639970704 us; error 28 us; skew 500 ppm
Sep 29 06:33:59 dist-test-slave-601b krb5kdc[12982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663639, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:33:59.973336 13357 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:33:59.973784 13357 webserver.cc:460] Webserver started at http://127.9.61.67:35787/ using document root <none> and password file <none>
I20260929 06:33:59.974010 13357 fs_manager.cc:359] Metadata directory not provided
I20260929 06:33:59.974053 13357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:33:59.974205 13357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:33:59.975282 13357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "a8654972a55540598ba30015a5ee38e6"
format_stamp: "Formatted at 2026-09-29 06:33:59 on dist-test-slave-601b"
server_key: "7ecdfaee2514d33486713e71f922482b"
server_key_iv: "63d9e281c7caa39bd856bd2498f7d692"
server_key_version: "encryptionkey@0"
I20260929 06:33:59.975633 13357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "a8654972a55540598ba30015a5ee38e6"
format_stamp: "Formatted at 2026-09-29 06:33:59 on dist-test-slave-601b"
server_key: "7ecdfaee2514d33486713e71f922482b"
server_key_iv: "63d9e281c7caa39bd856bd2498f7d692"
server_key_version: "encryptionkey@0"
I20260929 06:33:59.977097 13357 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:33:59.977759 13372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:59.977932 13357 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:33:59.978018 13357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "a8654972a55540598ba30015a5ee38e6"
format_stamp: "Formatted at 2026-09-29 06:33:59 on dist-test-slave-601b"
server_key: "7ecdfaee2514d33486713e71f922482b"
server_key_iv: "63d9e281c7caa39bd856bd2498f7d692"
server_key_version: "encryptionkey@0"
I20260929 06:33:59.978106 13357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:33:59.988299 13357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:33:59.990784 13357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:33:59.990938 13357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:33:59.991168 13357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:33:59.991439 13357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:33:59.991470 13357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:59.991492 13357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:33:59.991503 13357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:33:59.998137 13357 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:42101
I20260929 06:33:59.998230 13485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:42101 every 8 connection(s)
I20260929 06:33:59.998603 13357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:34:00.003697 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 13357
I20260929 06:34:00.003830 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:34:00.004050 9461 external_mini_cluster.cc:1428] Setting key 54e7d0c40f3ef91eac5b145bd3086201
Sep 29 06:34:00 dist-test-slave-601b krb5kdc[12982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663639, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:00.009287 13066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:59.999325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:46077 (local address 127.9.61.126:41415)
0929 06:33:59.999414 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0929 06:33:59.999416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:33:59.999662 (+ 246us) server_negotiation.cc:407] Connection header received
0929 06:34:00.000967 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:00.000969 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:00.000981 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:00.001026 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:00.001851 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:00.002628 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:00.004285 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:00.004585 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:00.004659 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:00.006930 (+ 2271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:00.006931 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:00.006931 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:00.006938 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:00.008184 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:00.008530 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:00.008530 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:00.008531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:00.008579 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:00.008778 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:00.008779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:00.008779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:00.008881 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:00.008932 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:00.009156 (+ 224us) server_negotiation.cc:299] Negotiation successful
0929 06:34:00.009223 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260929 06:34:00.009442 13488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:33:59.999318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41415 (local address 127.9.61.67:46077)
0929 06:33:59.999511 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 06:33:59.999561 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:00.000851 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:00.001096 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:00.001100 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:00.001463 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:00.001745 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:00.001753 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:00.002761 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:00.002763 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:00.004147 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:00.004150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:00.004669 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:00.004671 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:00.004822 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:00.005417 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:00.005428 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:00.006850 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:00.008255 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:00.008260 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:00.008262 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:00.008468 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:00.008635 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:00.008636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:00.008636 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:00.008725 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:00.008935 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:00.008939 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:00.009049 (+ 110us) client_negotiation.cc:769] Sending connection context
0929 06:34:00.009128 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:34:00.009250 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":90,"threads_started":1}
I20260929 06:34:00.009924 13486 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41415
I20260929 06:34:00.010026 13486 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:00.010195 13486 heartbeater.cc:511] Master 127.9.61.126:41415 requested a full tablet report, sending...
I20260929 06:34:00.010565 13027 ts_manager.cc:194] Registered new tserver with Master: a8654972a55540598ba30015a5ee38e6 (127.9.61.67:42101)
I20260929 06:34:00.010907 13027 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:46077
I20260929 06:34:00.016273 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 29 06:34:00 dist-test-slave-601b krb5kdc[12982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 06:34:00 dist-test-slave-601b krb5kdc[12982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.65@KRBTEST.COM
I20260929 06:34:00.038458 13493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:00.030700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45322 (local address 127.9.61.65:40905)
0929 06:34:00.030867 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:00.030879 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:00.030891 (+ 12us) server_negotiation.cc:407] Connection header received
0929 06:34:00.030917 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:00.030919 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:00.030932 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:00.030991 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:00.031621 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:00.032420 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:00.033136 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:00.033455 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:00.033508 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:00.035765 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:00.035775 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:00.035775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:00.035782 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:00.037482 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:00.037791 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:00.037794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:00.037794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:00.037851 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:00.038014 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:00.038014 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:00.038014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:00.038139 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:00.038248 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:00.038322 (+ 74us) server_negotiation.cc:299] Negotiation successful
0929 06:34:00.038382 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":99,"threads_started":1}
Sep 29 06:34:00 dist-test-slave-601b krb5kdc[12982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:00.046370 13066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:00.039762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44932 (local address 127.9.61.126:41415)
0929 06:34:00.039802 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:00.039804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:00.039815 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:34:00.039875 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:00.039876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:00.039884 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:00.039921 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:00.040451 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:00.040946 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:00.041565 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:00.041747 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:00.041797 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:00.043934 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:00.043936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:00.043936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:00.043968 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:00.045210 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:00.045560 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:00.045562 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:00.045562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:00.045633 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:00.045826 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:00.045827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:00.045828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:00.045974 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:00.046078 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:00.046195 (+ 117us) server_negotiation.cc:299] Negotiation successful
0929 06:34:00.046266 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 06:34:00.046609 13027 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44932
I20260929 06:34:00.046967 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 13089
I20260929 06:34:00.051716 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 13223
I20260929 06:34:00.055812 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 13357
I20260929 06:34:00.059918 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 12995
2026-09-29T06:34:00Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1845 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:34:00 dist-test-slave-601b krb5kdc[13498](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:34:00 dist-test-slave-601b krb5kdc[13498](info): set up 2 sockets
Sep 29 06:34:00 dist-test-slave-601b krb5kdc[13498](info): commencing operation
krb5kdc: starting...
W20260929 06:34:01.091863 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:34:01 dist-test-slave-601b krb5kdc[13498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:34:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:34:01.215421 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:39929
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:42129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:39929
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:01.294402 13511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:01.294603 13511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:01.294625 13511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:01.295694 13511 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:01.295730 13511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:01.295744 13511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:01.295756 13511 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:01.295768 13511 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:01.297223 13511 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:42129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:39929
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:39929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:01.297413 13511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:01.297580 13511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:01.302379 13517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:01.302389 13516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:01.302397 13519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:01.302834 13511 server_base.cc:1034] running on GCE node
I20260929 06:34:01.303103 13511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:01.303398 13511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:01.304620 13511 hybrid_clock.cc:648] HybridClock initialized: now 1790663641304602 us; error 34 us; skew 500 ppm
Sep 29 06:34:01 dist-test-slave-601b krb5kdc[13498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663641, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:01.307219 13511 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:34:01.307570 13511 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:01.307657 13511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:01.307806 13511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:01.308971 13511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "abcf3586002b48d7a543f83e42089323"
format_stamp: "Formatted at 2026-09-29 06:34:01 on dist-test-slave-601b"
server_key: "140d7ba7fe6e485c94ac11f2126553b8"
server_key_iv: "f36501118c0cd31b5ba9f0c032a790c3"
server_key_version: "encryptionkey@0"
I20260929 06:34:01.309345 13511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "abcf3586002b48d7a543f83e42089323"
format_stamp: "Formatted at 2026-09-29 06:34:01 on dist-test-slave-601b"
server_key: "140d7ba7fe6e485c94ac11f2126553b8"
server_key_iv: "f36501118c0cd31b5ba9f0c032a790c3"
server_key_version: "encryptionkey@0"
I20260929 06:34:01.310684 13511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:34:01.311502 13525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:01.311678 13511 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:01.311779 13511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "abcf3586002b48d7a543f83e42089323"
format_stamp: "Formatted at 2026-09-29 06:34:01 on dist-test-slave-601b"
server_key: "140d7ba7fe6e485c94ac11f2126553b8"
server_key_iv: "f36501118c0cd31b5ba9f0c032a790c3"
server_key_version: "encryptionkey@0"
I20260929 06:34:01.311872 13511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:01.322065 13511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:01.324460 13511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:01.324631 13511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:01.328449 13511 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:39929
I20260929 06:34:01.328476 13577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:39929 every 8 connection(s)
I20260929 06:34:01.328765 13511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:01.329721 13578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:01.329895 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 13511
I20260929 06:34:01.329988 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:01.330183 9461 external_mini_cluster.cc:1428] Setting key 3e27518dd4446276be863bd8384f7992
I20260929 06:34:01.333274 13578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323: Bootstrap starting.
I20260929 06:34:01.333974 13578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:01.334267 13578 log.cc:824] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:01.334986 13578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323: No bootstrap required, opened a new log
Sep 29 06:34:01 dist-test-slave-601b krb5kdc[13498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:01.337280 13578 raft_consensus.cc:348] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abcf3586002b48d7a543f83e42089323" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39929 } }
I20260929 06:34:01.337456 13578 raft_consensus.cc:374] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:01.337486 13578 raft_consensus.cc:729] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abcf3586002b48d7a543f83e42089323, State: Initialized, Role: FOLLOWER
I20260929 06:34:01.337637 13578 consensus_queue.cc:260] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abcf3586002b48d7a543f83e42089323" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39929 } }
I20260929 06:34:01.337707 13578 raft_consensus.cc:388] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:01.337728 13578 raft_consensus.cc:482] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:01.337795 13578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:01.338424 13578 raft_consensus.cc:504] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abcf3586002b48d7a543f83e42089323" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39929 } }
I20260929 06:34:01.338541 13578 leader_election.cc:302] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abcf3586002b48d7a543f83e42089323; no voters:
I20260929 06:34:01.338737 13578 leader_election.cc:288] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:01.338800 13583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:01.338925 13583 raft_consensus.cc:686] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [term 1 LEADER]: Becoming Leader. State: Replica: abcf3586002b48d7a543f83e42089323, State: Running, Role: LEADER
I20260929 06:34:01.338996 13583 consensus_queue.cc:237] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abcf3586002b48d7a543f83e42089323" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39929 } }
I20260929 06:34:01.339015 13578 sys_catalog.cc:564] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:01.339291 13583 sys_catalog.cc:455] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abcf3586002b48d7a543f83e42089323. Latest consensus state: current_term: 1 leader_uuid: "abcf3586002b48d7a543f83e42089323" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abcf3586002b48d7a543f83e42089323" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39929 } } }
I20260929 06:34:01.339452 13583 sys_catalog.cc:458] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:01.339709 13589 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:01.340251 13589 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:01.342043 13589 catalog_manager.cc:1347] Generated new cluster ID: 3b55746f06dc4f77a3f9a096189d14d1
I20260929 06:34:01.342041 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.330720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46332 (local address 127.9.61.126:39929)
0929 06:34:01.330931 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:01.330942 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:01.330972 (+ 30us) server_negotiation.cc:407] Connection header received
0929 06:34:01.331442 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:01.331451 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:01.331517 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:01.331675 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:01.332426 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.333773 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.334639 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.335112 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.335230 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.337977 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:01.337980 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:01.337980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:01.337990 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:01.340023 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:01.340444 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:01.340447 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:01.340447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:01.340544 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:01.340743 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:01.340744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:01.340745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:01.341067 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:01.341201 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:01.341720 (+ 519us) server_negotiation.cc:299] Negotiation successful
0929 06:34:01.341854 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":71,"threads_started":1}
I20260929 06:34:01.342264 13584 sys_catalog.cc:455] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abcf3586002b48d7a543f83e42089323" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abcf3586002b48d7a543f83e42089323" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39929 } } }
I20260929 06:34:01.342338 13584 sys_catalog.cc:458] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:01.342103 13589 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:34:01.365140 13589 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:01.365722 13589 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:01.372468 13589 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323: Generated new TSK 0
I20260929 06:34:01.372675 13589 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:34:01.406647 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39929
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:42129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:01.488943 13604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:01.489156 13604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:01.489180 13604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:01.490396 13604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:01.490440 13604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:01.490469 13604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:34:01.492126 13604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:42129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:01.492391 13604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:01.492671 13604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:01.497860 13612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:01.497820 13609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:01.497825 13610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:01.498167 13604 server_base.cc:1034] running on GCE node
I20260929 06:34:01.498426 13604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:01.498721 13604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:01.499903 13604 hybrid_clock.cc:648] HybridClock initialized: now 1790663641499898 us; error 42 us; skew 500 ppm
Sep 29 06:34:01 dist-test-slave-601b krb5kdc[13498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663641, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:01.502569 13604 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:34:01.502950 13604 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:01.503024 13604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:01.503192 13604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:01.504361 13604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "e985e3db6bd6493eb76a9115fb9ad55c"
format_stamp: "Formatted at 2026-09-29 06:34:01 on dist-test-slave-601b"
server_key: "9862c2bf2c9b6c9e857dfbac2f75ea8a"
server_key_iv: "307008e1787f1483fbd2c6e4c85f1ff6"
server_key_version: "encryptionkey@0"
I20260929 06:34:01.504719 13604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "e985e3db6bd6493eb76a9115fb9ad55c"
format_stamp: "Formatted at 2026-09-29 06:34:01 on dist-test-slave-601b"
server_key: "9862c2bf2c9b6c9e857dfbac2f75ea8a"
server_key_iv: "307008e1787f1483fbd2c6e4c85f1ff6"
server_key_version: "encryptionkey@0"
I20260929 06:34:01.506086 13604 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:01.506888 13618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:01.507067 13604 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:01.507172 13604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "e985e3db6bd6493eb76a9115fb9ad55c"
format_stamp: "Formatted at 2026-09-29 06:34:01 on dist-test-slave-601b"
server_key: "9862c2bf2c9b6c9e857dfbac2f75ea8a"
server_key_iv: "307008e1787f1483fbd2c6e4c85f1ff6"
server_key_version: "encryptionkey@0"
I20260929 06:34:01.507246 13604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:01.553156 13604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:01.555377 13604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:01.555560 13604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:01.555842 13604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:01.556219 13604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:01.556278 13604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:01.556322 13604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:01.556350 13604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:01.562315 13604 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:44159
I20260929 06:34:01.562363 13731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:44159 every 8 connection(s)
I20260929 06:34:01.562680 13604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:34:01 dist-test-slave-601b krb5kdc[13498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663641, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:01.572089 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 13604
I20260929 06:34:01.572202 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:34:01.572412 9461 external_mini_cluster.cc:1428] Setting key b248e89506b146b4af57d186055fc0a0
I20260929 06:34:01.572672 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.563566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:59835 (local address 127.9.61.126:39929)
0929 06:34:01.563645 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:01.563647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:01.563905 (+ 258us) server_negotiation.cc:407] Connection header received
0929 06:34:01.564487 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:01.564488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:01.564498 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:01.564561 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:01.565530 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.566034 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.567017 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.567333 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.567395 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.569625 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:01.569627 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:01.569627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:01.569635 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:01.570997 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:01.571509 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:01.571510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:01.571511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:01.571566 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:01.571847 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:01.571848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:01.571848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:01.572020 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:01.572074 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:01.572428 (+ 354us) server_negotiation.cc:299] Negotiation successful
0929 06:34:01.572544 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 06:34:01.572849 13734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.563561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:39929 (local address 127.9.61.65:59835)
0929 06:34:01.563760 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:01.563803 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:01.564395 (+ 592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:01.564619 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:01.564623 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:01.564899 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:01.565412 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:01.565417 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.566124 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.566125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:01.566933 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:01.566935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.567413 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.567414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:01.567521 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.568145 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:01.568154 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:01.569542 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:01.571090 (+ 1548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:01.571096 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:01.571098 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:01.571437 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:01.571632 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:01.571633 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:01.571633 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:01.571765 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:01.572083 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:01.572090 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:01.572278 (+ 188us) client_negotiation.cc:769] Sending connection context
0929 06:34:01.572410 (+ 132us) client_negotiation.cc:240] Negotiation successful
0929 06:34:01.572594 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":87,"threads_started":1}
I20260929 06:34:01.573410 13732 heartbeater.cc:347] Connected to a master server at 127.9.61.126:39929
I20260929 06:34:01.573498 13732 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:01.573685 13732 heartbeater.cc:511] Master 127.9.61.126:39929 requested a full tablet report, sending...
I20260929 06:34:01.574251 13542 ts_manager.cc:194] Registered new tserver with Master: e985e3db6bd6493eb76a9115fb9ad55c (127.9.61.65:44159)
I20260929 06:34:01.574873 13542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:59835
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:34:01.600559 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39929
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:42129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:01.683130 13737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:01.683360 13737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:01.683386 13737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:01.684525 13737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:01.684564 13737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:01.684590 13737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:34:01.686131 13737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:42129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:01.686333 13737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:01.686517 13737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:01.691483 13743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:01.691509 13742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:01.691506 13745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:01.691780 13737 server_base.cc:1034] running on GCE node
I20260929 06:34:01.692054 13737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:01.692345 13737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:01.693533 13737 hybrid_clock.cc:648] HybridClock initialized: now 1790663641693513 us; error 47 us; skew 500 ppm
Sep 29 06:34:01 dist-test-slave-601b krb5kdc[13498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663641, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:01.696231 13737 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:34:01.696589 13737 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:01.696661 13737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:01.696821 13737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:01.697892 13737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "07a2c518dc12489b9eea453e6617d2e0"
format_stamp: "Formatted at 2026-09-29 06:34:01 on dist-test-slave-601b"
server_key: "843ffff396bbf8249f911b1625fd5b51"
server_key_iv: "5f5113e7e2736599de146942fa827a0b"
server_key_version: "encryptionkey@0"
I20260929 06:34:01.698262 13737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "07a2c518dc12489b9eea453e6617d2e0"
format_stamp: "Formatted at 2026-09-29 06:34:01 on dist-test-slave-601b"
server_key: "843ffff396bbf8249f911b1625fd5b51"
server_key_iv: "5f5113e7e2736599de146942fa827a0b"
server_key_version: "encryptionkey@0"
I20260929 06:34:01.699568 13737 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:34:01.700340 13751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:01.700510 13737 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:01.700615 13737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "07a2c518dc12489b9eea453e6617d2e0"
format_stamp: "Formatted at 2026-09-29 06:34:01 on dist-test-slave-601b"
server_key: "843ffff396bbf8249f911b1625fd5b51"
server_key_iv: "5f5113e7e2736599de146942fa827a0b"
server_key_version: "encryptionkey@0"
I20260929 06:34:01.700691 13737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:01.726686 13737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:01.729120 13737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:01.729359 13737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:01.729611 13737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:01.729961 13737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:01.730017 13737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:01.730053 13737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:01.730103 13737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:01.736034 13737 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:40333
I20260929 06:34:01.736078 13864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:40333 every 8 connection(s)
I20260929 06:34:01.736370 13737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:34:01 dist-test-slave-601b krb5kdc[13498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663641, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:01.745846 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 13737
I20260929 06:34:01.745975 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:34:01.745986 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.737133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:60323 (local address 127.9.61.126:39929)
0929 06:34:01.737200 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:01.737202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:01.737438 (+ 236us) server_negotiation.cc:407] Connection header received
0929 06:34:01.737904 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:01.737905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:01.737916 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:01.737980 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:01.739009 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.739547 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.740689 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.740885 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.740972 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.743209 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:01.743211 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:01.743212 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:01.743220 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:01.744549 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:01.745006 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:01.745008 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:01.745009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:01.745069 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:01.745321 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:01.745322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:01.745322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:01.745442 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:01.745519 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:01.745806 (+ 287us) server_negotiation.cc:299] Negotiation successful
0929 06:34:01.745889 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:34:01.746191 13867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.737088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:39929 (local address 127.9.61.66:60323)
0929 06:34:01.737278 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:01.737337 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:01.737818 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:01.738054 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:01.738058 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:01.738380 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:01.738887 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:01.738891 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.739655 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.739656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:01.740577 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:01.740580 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.740983 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.740985 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:01.741122 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.741708 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:01.741717 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:01.743090 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:01.744680 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:01.744687 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:01.744689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:01.744913 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:01.745139 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:01.745140 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:01.745140 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:01.745251 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:01.745521 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:01.745529 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:01.745673 (+ 144us) client_negotiation.cc:769] Sending connection context
0929 06:34:01.745788 (+ 115us) client_negotiation.cc:240] Negotiation successful
0929 06:34:01.745952 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":109,"threads_started":1}
I20260929 06:34:01.746199 9461 external_mini_cluster.cc:1428] Setting key ae15d5d9bc91d20eb5bb313c0fd7717b
I20260929 06:34:01.746724 13865 heartbeater.cc:347] Connected to a master server at 127.9.61.126:39929
I20260929 06:34:01.746820 13865 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:01.747001 13865 heartbeater.cc:511] Master 127.9.61.126:39929 requested a full tablet report, sending...
I20260929 06:34:01.747438 13541 ts_manager.cc:194] Registered new tserver with Master: 07a2c518dc12489b9eea453e6617d2e0 (127.9.61.66:40333)
I20260929 06:34:01.747822 13541 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:60323
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:34:01.771659 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39929
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:42129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:01.854823 13870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:01.855084 13870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:01.855134 13870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:01.856438 13870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:01.856508 13870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:01.856554 13870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:34:01.858143 13870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:42129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:01.858426 13870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:01.858670 13870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:01.863727 13875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:01.863745 13878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:01.863740 13876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:01.864001 13870 server_base.cc:1034] running on GCE node
I20260929 06:34:01.864233 13870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:01.864485 13870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:01.865667 13870 hybrid_clock.cc:648] HybridClock initialized: now 1790663641865659 us; error 37 us; skew 500 ppm
Sep 29 06:34:01 dist-test-slave-601b krb5kdc[13498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663641, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:01.868455 13870 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:34:01.868870 13870 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:01.868942 13870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:01.869087 13870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:01.870186 13870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "cf4c0aea85e14596a87ce19dee4ef8ff"
format_stamp: "Formatted at 2026-09-29 06:34:01 on dist-test-slave-601b"
server_key: "1883dbd558daf51e8b212693e2306b2d"
server_key_iv: "6a92cc4dc624332a6a0e8318fcaf6a77"
server_key_version: "encryptionkey@0"
I20260929 06:34:01.870561 13870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "cf4c0aea85e14596a87ce19dee4ef8ff"
format_stamp: "Formatted at 2026-09-29 06:34:01 on dist-test-slave-601b"
server_key: "1883dbd558daf51e8b212693e2306b2d"
server_key_iv: "6a92cc4dc624332a6a0e8318fcaf6a77"
server_key_version: "encryptionkey@0"
I20260929 06:34:01.872049 13870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:34:01.872915 13884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:01.873242 13870 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:01.873329 13870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "cf4c0aea85e14596a87ce19dee4ef8ff"
format_stamp: "Formatted at 2026-09-29 06:34:01 on dist-test-slave-601b"
server_key: "1883dbd558daf51e8b212693e2306b2d"
server_key_iv: "6a92cc4dc624332a6a0e8318fcaf6a77"
server_key_version: "encryptionkey@0"
I20260929 06:34:01.873386 13870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:01.896476 13870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:01.898579 13870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:01.898693 13870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:01.898903 13870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:01.899256 13870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:01.899291 13870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:01.899313 13870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:01.899326 13870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:01.905488 13870 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:41107
I20260929 06:34:01.905571 13997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:41107 every 8 connection(s)
I20260929 06:34:01.905856 13870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:34:01.906962 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 13870
I20260929 06:34:01.907042 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:34:01.907248 9461 external_mini_cluster.cc:1428] Setting key 32a9f1ff72f0df34a10b0cb9c81a4107
Sep 29 06:34:01 dist-test-slave-601b krb5kdc[13498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663641, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:01.915190 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.906582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:57361 (local address 127.9.61.126:39929)
0929 06:34:01.906647 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:01.906648 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:01.906864 (+ 216us) server_negotiation.cc:407] Connection header received
0929 06:34:01.907522 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:01.907523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:01.907534 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:01.907602 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:01.908724 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.909205 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.910248 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.910424 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.910502 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.912594 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:01.912596 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:01.912596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:01.912603 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:01.913957 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:01.914352 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:01.914353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:01.914353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:01.914405 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:01.914612 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:01.914612 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:01.914612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:01.914727 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:01.914774 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:01.915029 (+ 255us) server_negotiation.cc:299] Negotiation successful
0929 06:34:01.915087 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:34:01.915452 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.906570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:39929 (local address 127.9.61.67:57361)
0929 06:34:01.906742 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:01.906777 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:01.907415 (+ 638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:01.907678 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:01.907683 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:01.908117 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:01.908637 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:01.908643 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.909287 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.909288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:01.910168 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:01.910171 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.910497 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.910498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:01.910632 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.911090 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:01.911103 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:01.912511 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:01.914048 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:01.914054 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:01.914056 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:01.914283 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:01.914461 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:01.914462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:01.914462 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:01.914558 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:01.914779 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:01.914783 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:01.914896 (+ 113us) client_negotiation.cc:769] Sending connection context
0929 06:34:01.915011 (+ 115us) client_negotiation.cc:240] Negotiation successful
0929 06:34:01.915214 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":83,"threads_started":1}
I20260929 06:34:01.915937 13998 heartbeater.cc:347] Connected to a master server at 127.9.61.126:39929
I20260929 06:34:01.916088 13998 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:01.916245 13998 heartbeater.cc:511] Master 127.9.61.126:39929 requested a full tablet report, sending...
I20260929 06:34:01.916638 13541 ts_manager.cc:194] Registered new tserver with Master: cf4c0aea85e14596a87ce19dee4ef8ff (127.9.61.67:41107)
I20260929 06:34:01.917003 13541 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:57361
I20260929 06:34:01.918928 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:34:01.925982 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.920214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46336 (local address 127.9.61.126:39929)
0929 06:34:01.920260 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:01.920262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:01.920369 (+ 107us) server_negotiation.cc:407] Connection header received
0929 06:34:01.920422 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:01.920423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:01.920431 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:01.920483 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:01.921019 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.921489 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.922203 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.922383 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.922436 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.923552 (+ 1116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:01.923553 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:01.923554 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:01.923559 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:01.925026 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:01.925330 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:01.925331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:01.925332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:01.925379 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:01.925527 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:01.925528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:01.925528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:01.925662 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:01.925731 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:01.925834 (+ 103us) server_negotiation.cc:299] Negotiation successful
0929 06:34:01.925889 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:34:01.927716 13541 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:34:01.929373 13541 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:34:01.936003 14009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.931634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:44159 (local address 127.0.0.1:45106)
0929 06:34:01.931761 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:01.931794 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:01.931878 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:01.932256 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:01.932261 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:01.932264 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:01.932340 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:01.932343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.933733 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.933734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:01.934911 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:01.934914 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.935659 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.935660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:01.935744 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.935758 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 06:34:01.935831 (+ 73us) client_negotiation.cc:240] Negotiation successful
0929 06:34:01.935891 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":5,"thread_start_us":88,"threads_started":1}
I20260929 06:34:01.936014 14010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.931757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45106 (local address 127.9.61.65:44159)
0929 06:34:01.931974 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:01.931980 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:01.931989 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:01.932033 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:01.932035 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:01.932051 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:01.932144 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:01.932439 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.933630 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.935003 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.935563 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.935658 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.935723 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:01.935861 (+ 138us) server_negotiation.cc:299] Negotiation successful
0929 06:34:01.935901 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":96,"threads_started":1}
I20260929 06:34:01.936344 14014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.932321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57722 (local address 127.9.61.67:41107)
0929 06:34:01.932635 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:01.932639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:01.932648 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:01.932685 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:01.932686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:01.932700 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:01.932772 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:01.932975 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.933960 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.935120 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.935788 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.935858 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.935915 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:01.936218 (+ 303us) server_negotiation.cc:299] Negotiation successful
0929 06:34:01.936268 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":96,"threads_started":1}
I20260929 06:34:01.936514 14013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.932127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51492 (local address 127.9.61.66:40333)
0929 06:34:01.932310 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:01.932316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:01.932326 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:34:01.932361 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:01.932363 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:01.932379 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:01.932450 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:01.932548 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.933417 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.935032 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.935783 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.936270 (+ 487us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.936346 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:01.936372 (+ 26us) server_negotiation.cc:299] Negotiation successful
0929 06:34:01.936423 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":83,"threads_started":1}
I20260929 06:34:01.936177 14011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.931870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:40333 (local address 127.0.0.1:51492)
0929 06:34:01.932041 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:01.932052 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:01.932103 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:01.932453 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:01.932454 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:01.932456 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:01.932495 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:01.932496 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.933516 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.933518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:01.934911 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:01.934914 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.935888 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.935889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:01.935985 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.935989 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:01.936020 (+ 31us) client_negotiation.cc:240] Negotiation successful
0929 06:34:01.936065 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":34,"thread_start_us":99,"threads_started":1}
I20260929 06:34:01.936179 14012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:01.932068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:41107 (local address 127.0.0.1:57722)
0929 06:34:01.932214 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:01.932224 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:01.932264 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:01.932851 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:01.932852 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:01.932854 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:01.932892 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:01.932893 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.934057 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.934058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:01.935027 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:01.935029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:01.935978 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:01.935979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:01.936036 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:01.936038 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:34:01.936082 (+ 44us) client_negotiation.cc:240] Negotiation successful
0929 06:34:01.936113 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":107,"threads_started":1}
I20260929 06:34:01.937299 13666 tablet_service.cc:1467] Processing CreateTablet for tablet 100e907f7126441282806eeb2518dff5 (DEFAULT_TABLE table=test-table [id=02dbb6907c42489ebea9eb43161962da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:01.937295 13932 tablet_service.cc:1467] Processing CreateTablet for tablet 100e907f7126441282806eeb2518dff5 (DEFAULT_TABLE table=test-table [id=02dbb6907c42489ebea9eb43161962da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:01.937674 13666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 100e907f7126441282806eeb2518dff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:01.937674 13932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 100e907f7126441282806eeb2518dff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:01.940464 13799 tablet_service.cc:1467] Processing CreateTablet for tablet 100e907f7126441282806eeb2518dff5 (DEFAULT_TABLE table=test-table [id=02dbb6907c42489ebea9eb43161962da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:01.940837 13799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 100e907f7126441282806eeb2518dff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:01.941226 14015 tablet_bootstrap.cc:492] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff: Bootstrap starting.
I20260929 06:34:01.941831 14015 tablet_bootstrap.cc:654] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:01.942358 14015 log.cc:824] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:01.943081 14015 tablet_bootstrap.cc:492] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff: No bootstrap required, opened a new log
I20260929 06:34:01.943189 14015 ts_tablet_manager.cc:1397] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:34:01.943890 14017 tablet_bootstrap.cc:492] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0: Bootstrap starting.
I20260929 06:34:01.944578 14017 tablet_bootstrap.cc:654] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:01.944972 14015 raft_consensus.cc:348] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44159 } } peers { permanent_uuid: "07a2c518dc12489b9eea453e6617d2e0" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40333 } } peers { permanent_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41107 } }
I20260929 06:34:01.945147 14018 tablet_bootstrap.cc:492] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c: Bootstrap starting.
I20260929 06:34:01.945209 14017 log.cc:824] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:01.945276 14015 raft_consensus.cc:374] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:01.945356 14015 raft_consensus.cc:729] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf4c0aea85e14596a87ce19dee4ef8ff, State: Initialized, Role: FOLLOWER
I20260929 06:34:01.945513 14015 consensus_queue.cc:260] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44159 } } peers { permanent_uuid: "07a2c518dc12489b9eea453e6617d2e0" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40333 } } peers { permanent_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41107 } }
I20260929 06:34:01.945856 14018 tablet_bootstrap.cc:654] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:01.945950 13998 heartbeater.cc:503] Master 127.9.61.126:39929 was elected leader, sending a full tablet report...
I20260929 06:34:01.946034 14017 tablet_bootstrap.cc:492] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0: No bootstrap required, opened a new log
I20260929 06:34:01.945946 14015 ts_tablet_manager.cc:1428] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:34:01.946105 14017 ts_tablet_manager.cc:1397] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:34:01.946518 14018 log.cc:824] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:01.947343 14018 tablet_bootstrap.cc:492] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c: No bootstrap required, opened a new log
I20260929 06:34:01.947422 14018 ts_tablet_manager.cc:1397] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:34:01.948329 14017 raft_consensus.cc:348] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44159 } } peers { permanent_uuid: "07a2c518dc12489b9eea453e6617d2e0" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40333 } } peers { permanent_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41107 } }
I20260929 06:34:01.948504 14017 raft_consensus.cc:374] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:01.948550 14017 raft_consensus.cc:729] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a2c518dc12489b9eea453e6617d2e0, State: Initialized, Role: FOLLOWER
I20260929 06:34:01.948676 14017 consensus_queue.cc:260] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44159 } } peers { permanent_uuid: "07a2c518dc12489b9eea453e6617d2e0" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40333 } } peers { permanent_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41107 } }
I20260929 06:34:01.948989 14017 ts_tablet_manager.cc:1428] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:34:01.949005 13865 heartbeater.cc:503] Master 127.9.61.126:39929 was elected leader, sending a full tablet report...
I20260929 06:34:01.949451 14018 raft_consensus.cc:348] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44159 } } peers { permanent_uuid: "07a2c518dc12489b9eea453e6617d2e0" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40333 } } peers { permanent_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41107 } }
I20260929 06:34:01.949649 14018 raft_consensus.cc:374] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:01.949690 14018 raft_consensus.cc:729] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e985e3db6bd6493eb76a9115fb9ad55c, State: Initialized, Role: FOLLOWER
I20260929 06:34:01.949806 14018 consensus_queue.cc:260] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44159 } } peers { permanent_uuid: "07a2c518dc12489b9eea453e6617d2e0" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40333 } } peers { permanent_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41107 } }
I20260929 06:34:01.950115 14018 ts_tablet_manager.cc:1428] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:34:01.950135 13732 heartbeater.cc:503] Master 127.9.61.126:39929 was elected leader, sending a full tablet report...
W20260929 06:34:01.987010 13866 tablet.cc:2369] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:34:02.063448 13733 tablet.cc:2369] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:34:02.080374 14023 raft_consensus.cc:482] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:34:02.080499 14023 raft_consensus.cc:504] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44159 } } peers { permanent_uuid: "07a2c518dc12489b9eea453e6617d2e0" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40333 } } peers { permanent_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41107 } }
I20260929 06:34:02.080943 14023 leader_election.cc:288] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07a2c518dc12489b9eea453e6617d2e0 (127.9.61.66:40333), cf4c0aea85e14596a87ce19dee4ef8ff (127.9.61.67:41107)
I20260929 06:34:02.084132 14024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.081287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:40333 (local address 127.9.61.65:46249)
0929 06:34:02.081445 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:02.081458 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:02.081526 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:02.081705 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:02.081707 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:02.081710 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:02.081772 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:02.081774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:02.082424 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:02.082425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:02.083240 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:02.083243 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:02.083836 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:02.083837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:02.083899 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:02.083902 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:34:02.083997 (+ 95us) client_negotiation.cc:240] Negotiation successful
0929 06:34:02.084042 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":110,"threads_started":1}
I20260929 06:34:02.084116 14013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.081371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:46249 (local address 127.9.61.66:40333)
0929 06:34:02.081450 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.081453 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.081533 (+ 80us) server_negotiation.cc:407] Connection header received
0929 06:34:02.081603 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.081604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.081616 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.081695 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:02.081856 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:02.082334 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:02.083356 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:02.083741 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:02.083822 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:02.083834 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.084005 (+ 171us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.084043 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260929 06:34:02.084288 14014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.081644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:51853 (local address 127.9.61.67:41107)
0929 06:34:02.081718 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.081721 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.081782 (+ 61us) server_negotiation.cc:407] Connection header received
0929 06:34:02.081855 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.081856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.081867 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.081912 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:02.082071 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:02.082528 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:02.083506 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:02.083895 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:02.084014 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:02.084025 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.084186 (+ 161us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.084226 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260929 06:34:02.084303 14025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.081521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:41107 (local address 127.9.61.65:51853)
0929 06:34:02.081728 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:02.081738 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:02.081792 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:02.081914 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:02.081915 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:02.081916 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:02.081990 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:02.081992 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:02.082615 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:02.082617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:02.083406 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:02.083408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:02.084021 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:02.084022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:02.084101 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:02.084104 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:34:02.084180 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 06:34:02.084218 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":50,"threads_started":1}
I20260929 06:34:02.084848 13819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "100e907f7126441282806eeb2518dff5" candidate_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a2c518dc12489b9eea453e6617d2e0" is_pre_election: true
I20260929 06:34:02.084908 13952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "100e907f7126441282806eeb2518dff5" candidate_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff" is_pre_election: true
I20260929 06:34:02.085008 13819 raft_consensus.cc:2454] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e985e3db6bd6493eb76a9115fb9ad55c in term 0.
I20260929 06:34:02.085076 13952 raft_consensus.cc:2454] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e985e3db6bd6493eb76a9115fb9ad55c in term 0.
I20260929 06:34:02.085259 13622 leader_election.cc:302] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a2c518dc12489b9eea453e6617d2e0, e985e3db6bd6493eb76a9115fb9ad55c; no voters:
I20260929 06:34:02.085421 14023 raft_consensus.cc:2781] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:34:02.085500 14023 raft_consensus.cc:482] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:34:02.085520 14023 raft_consensus.cc:3037] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:02.086225 14023 raft_consensus.cc:504] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44159 } } peers { permanent_uuid: "07a2c518dc12489b9eea453e6617d2e0" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40333 } } peers { permanent_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41107 } }
I20260929 06:34:02.086331 14023 leader_election.cc:288] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [CANDIDATE]: Term 1 election: Requested vote from peers 07a2c518dc12489b9eea453e6617d2e0 (127.9.61.66:40333), cf4c0aea85e14596a87ce19dee4ef8ff (127.9.61.67:41107)
I20260929 06:34:02.086536 13819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "100e907f7126441282806eeb2518dff5" candidate_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a2c518dc12489b9eea453e6617d2e0"
I20260929 06:34:02.086567 13952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "100e907f7126441282806eeb2518dff5" candidate_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff"
I20260929 06:34:02.086639 13952 raft_consensus.cc:3037] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:02.086638 13819 raft_consensus.cc:3037] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:02.087347 13952 raft_consensus.cc:2454] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e985e3db6bd6493eb76a9115fb9ad55c in term 1.
I20260929 06:34:02.087471 13819 raft_consensus.cc:2454] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e985e3db6bd6493eb76a9115fb9ad55c in term 1.
I20260929 06:34:02.087507 13622 leader_election.cc:302] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf4c0aea85e14596a87ce19dee4ef8ff, e985e3db6bd6493eb76a9115fb9ad55c; no voters:
I20260929 06:34:02.087620 14023 raft_consensus.cc:2781] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:02.087816 14023 raft_consensus.cc:686] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [term 1 LEADER]: Becoming Leader. State: Replica: e985e3db6bd6493eb76a9115fb9ad55c, State: Running, Role: LEADER
I20260929 06:34:02.087939 14023 consensus_queue.cc:237] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44159 } } peers { permanent_uuid: "07a2c518dc12489b9eea453e6617d2e0" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40333 } } peers { permanent_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41107 } }
I20260929 06:34:02.088804 13541 catalog_manager.cc:5495] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c reported cstate change: term changed from 0 to 1, leader changed from <none> to e985e3db6bd6493eb76a9115fb9ad55c (127.9.61.65). New cstate: current_term: 1 leader_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e985e3db6bd6493eb76a9115fb9ad55c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a2c518dc12489b9eea453e6617d2e0" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41107 } health_report { overall_health: UNKNOWN } } }
I20260929 06:34:02.118667 14010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.116204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45116 (local address 127.9.61.65:44159)
0929 06:34:02.116252 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.116254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.116290 (+ 36us) server_negotiation.cc:407] Connection header received
0929 06:34:02.116326 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.116326 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.116345 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.116412 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:34:02.116618 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:02.117100 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:02.117908 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:02.118098 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:02.118186 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:02.118316 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:34:02.118427 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:34:02.118487 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.118525 (+ 38us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.118543 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:34:02.120703 13952 raft_consensus.cc:1261] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff [term 1 FOLLOWER]: Refusing update from remote peer e985e3db6bd6493eb76a9115fb9ad55c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:02.120749 13819 raft_consensus.cc:1261] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0 [term 1 FOLLOWER]: Refusing update from remote peer e985e3db6bd6493eb76a9115fb9ad55c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:02.121119 14023 consensus_queue.cc:1035] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a2c518dc12489b9eea453e6617d2e0" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:02.121295 14026 consensus_queue.cc:1035] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf4c0aea85e14596a87ce19dee4ef8ff" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:02.123775 14030 mvcc.cc:205] Tried to move back new op lower bound from 7334558278122983424 to 7334558277993095168. Current Snapshot: MvccSnapshot[applied={T|T < 7334558278122983424}]
I20260929 06:34:02.126641 13542 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:02.126754 13542 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:02.127523 13542 catalog_manager.cc:5782] T 00000000000000000000000000000000 P abcf3586002b48d7a543f83e42089323: Sending DeleteTablet for 3 replicas of tablet 100e907f7126441282806eeb2518dff5
I20260929 06:34:02.127914 13932 tablet_service.cc:1514] Processing DeleteTablet for tablet 100e907f7126441282806eeb2518dff5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:02 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:57722
I20260929 06:34:02.127912 13666 tablet_service.cc:1514] Processing DeleteTablet for tablet 100e907f7126441282806eeb2518dff5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:02 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:45106
I20260929 06:34:02.128155 13799 tablet_service.cc:1514] Processing DeleteTablet for tablet 100e907f7126441282806eeb2518dff5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:02 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:51492
I20260929 06:34:02.128369 14041 tablet_replica.cc:330] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0: stopping tablet replica
I20260929 06:34:02.128465 14039 tablet_replica.cc:330] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c: stopping tablet replica
I20260929 06:34:02.128509 14041 raft_consensus.cc:2229] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:02.128561 14039 raft_consensus.cc:2229] T 100e907f7126441282806eeb2518dff5 P e985e3db6bd6493eb76a9115fb9ad55c [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:34:02.128643 14041 raft_consensus.cc:2258] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:02.128800 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 13604
I20260929 06:34:02.129101 14041 ts_tablet_manager.cc:1905] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:02.129817 14040 tablet_replica.cc:330] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff: stopping tablet replica
I20260929 06:34:02.130012 14040 raft_consensus.cc:2229] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:02.130178 14040 raft_consensus.cc:2258] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:02.130663 14040 ts_tablet_manager.cc:1905] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:02.130894 14041 ts_tablet_manager.cc:1918] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:02.130966 14041 log.cc:1196] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/100e907f7126441282806eeb2518dff5
I20260929 06:34:02.131306 14041 ts_tablet_manager.cc:1939] T 100e907f7126441282806eeb2518dff5 P 07a2c518dc12489b9eea453e6617d2e0: Deleting consensus metadata
I20260929 06:34:02.131774 13529 catalog_manager.cc:4841] TS 07a2c518dc12489b9eea453e6617d2e0 (127.9.61.66:40333): tablet 100e907f7126441282806eeb2518dff5 (table test-table [id=02dbb6907c42489ebea9eb43161962da]) successfully deleted
I20260929 06:34:02.132310 14040 ts_tablet_manager.cc:1918] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:02.132395 14040 log.cc:1196] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/100e907f7126441282806eeb2518dff5
I20260929 06:34:02.132675 14040 ts_tablet_manager.cc:1939] T 100e907f7126441282806eeb2518dff5 P cf4c0aea85e14596a87ce19dee4ef8ff: Deleting consensus metadata
I20260929 06:34:02.133062 13529 catalog_manager.cc:4841] TS cf4c0aea85e14596a87ce19dee4ef8ff (127.9.61.67:41107): tablet 100e907f7126441282806eeb2518dff5 (table test-table [id=02dbb6907c42489ebea9eb43161962da]) successfully deleted
W20260929 06:34:02.134538 13529 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:44159 (error 108)
I20260929 06:34:02.134915 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 13737
I20260929 06:34:02.135500 14012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.134972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:44159 (local address 127.0.0.1:45126)
0929 06:34:02.135417 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:02.135460 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:44159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422}
W20260929 06:34:02.135654 13529 catalog_manager.cc:4584] TS e985e3db6bd6493eb76a9115fb9ad55c (127.9.61.65:44159): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 100e907f7126441282806eeb2518dff5: Network error: Client connection negotiation failed: client connection to 127.9.61.65:44159: connect: Connection refused (error 111)
I20260929 06:34:02.139842 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 13870
I20260929 06:34:02.144229 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 13511
2026-09-29T06:34:02Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2084 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-29T06:34:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:02Z Disabled control of system clock
I20260929 06:34:02.171663 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:37603
--webserver_interface=127.9.61.126
--webserver_port=0
--builtin_ntp_servers=127.9.61.84:33065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:37603
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 06:34:02.253965 14046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:02.254216 14046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:02.254240 14046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:02.255466 14046 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:02.255537 14046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:02.255551 14046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:02.255582 14046 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:02.255635 14046 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:02.257048 14046 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:33065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:37603
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:37603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:02.257349 14046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:02.257676 14046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:34:02.262845 14046 server_base.cc:1034] running on GCE node
W20260929 06:34:02.262786 14052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:02.262794 14051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:02.262792 14054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:02.263306 14046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:02.263568 14046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:02.264714 14046 hybrid_clock.cc:648] HybridClock initialized: now 1790663642264695 us; error 34 us; skew 500 ppm
I20260929 06:34:02.266242 14046 webserver.cc:460] Webserver started at http://127.9.61.126:40387/ using document root <none> and password file <none>
I20260929 06:34:02.266498 14046 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:02.266546 14046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:02.266696 14046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:02.267823 14046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "fb2526d9c0a54538b848c050f2489765"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "428f1871019f439d49061c070144e8e3"
server_key_iv: "32128a4d6084af5f4ac14cd18e25f0b1"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.268285 14046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "fb2526d9c0a54538b848c050f2489765"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "428f1871019f439d49061c070144e8e3"
server_key_iv: "32128a4d6084af5f4ac14cd18e25f0b1"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.269728 14046 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:02.270431 14060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:02.270615 14046 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:02.270712 14046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "fb2526d9c0a54538b848c050f2489765"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "428f1871019f439d49061c070144e8e3"
server_key_iv: "32128a4d6084af5f4ac14cd18e25f0b1"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.270802 14046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:02.274427 14046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:02.274682 14046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:02.274838 14046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:02.278824 14046 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:37603
I20260929 06:34:02.278910 14112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:37603 every 8 connection(s)
I20260929 06:34:02.279241 14046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:02.280023 14113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:02.282801 14113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765: Bootstrap starting.
I20260929 06:34:02.283345 14113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:02.283581 14113 log.cc:824] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:02.284264 14113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765: No bootstrap required, opened a new log
I20260929 06:34:02.285842 14113 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb2526d9c0a54538b848c050f2489765" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37603 } }
I20260929 06:34:02.285985 14113 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:02.286007 14113 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb2526d9c0a54538b848c050f2489765, State: Initialized, Role: FOLLOWER
I20260929 06:34:02.286155 14113 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb2526d9c0a54538b848c050f2489765" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37603 } }
I20260929 06:34:02.286242 14113 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:02.286265 14113 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:02.286329 14113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:02.286319 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 14046
I20260929 06:34:02.286437 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:02.286619 9461 external_mini_cluster.cc:1428] Setting key 68a5325b2bb569b7632c362d2b6ec2c9
I20260929 06:34:02.287092 14113 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb2526d9c0a54538b848c050f2489765" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37603 } }
I20260929 06:34:02.287236 14113 leader_election.cc:302] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb2526d9c0a54538b848c050f2489765; no voters:
I20260929 06:34:02.287420 14113 leader_election.cc:288] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:02.287477 14118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:02.287644 14118 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [term 1 LEADER]: Becoming Leader. State: Replica: fb2526d9c0a54538b848c050f2489765, State: Running, Role: LEADER
I20260929 06:34:02.287671 14113 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:02.287750 14118 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb2526d9c0a54538b848c050f2489765" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37603 } }
I20260929 06:34:02.289016 14120 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb2526d9c0a54538b848c050f2489765. Latest consensus state: current_term: 1 leader_uuid: "fb2526d9c0a54538b848c050f2489765" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb2526d9c0a54538b848c050f2489765" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37603 } } }
I20260929 06:34:02.289165 14119 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb2526d9c0a54538b848c050f2489765" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb2526d9c0a54538b848c050f2489765" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37603 } } }
I20260929 06:34:02.289283 14119 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:02.289170 14120 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:02.289376 14117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.287159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57432 (local address 127.9.61.126:37603)
0929 06:34:02.287457 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.287466 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.287509 (+ 43us) server_negotiation.cc:407] Connection header received
0929 06:34:02.287655 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.287663 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.287721 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.287881 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:02.288600 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:02.288604 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:02.288605 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:02.288610 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:02.288659 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:02.288675 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:02.288756 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.289017 (+ 261us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.289082 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":126,"threads_started":1}
W20260929 06:34:02.289796 14132 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:34:02.289853 14132 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:34:02.289937 14133 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:02.290156 14133 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:02.292968 14133 catalog_manager.cc:1347] Generated new cluster ID: 104a33a266a34c8e9435dd28524de35e
I20260929 06:34:02.293032 14133 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:34:02.302048 14133 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:02.302237 14133 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:02.309468 14133 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765: Generated new TSK 0
I20260929 06:34:02.309675 14133 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:34:02.314756 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37603
--builtin_ntp_servers=127.9.61.84:33065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 06:34:02.396160 14137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:02.396396 14137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:02.396421 14137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:02.397696 14137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:02.397740 14137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:02.397768 14137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:34:02.399267 14137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:33065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:02.399544 14137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:02.399868 14137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:02.406005 14142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:02.406010 14143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:02.406266 14137 server_base.cc:1034] running on GCE node
W20260929 06:34:02.406010 14145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:02.406559 14137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:02.406836 14137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:02.408003 14137 hybrid_clock.cc:648] HybridClock initialized: now 1790663642407981 us; error 37 us; skew 500 ppm
I20260929 06:34:02.409458 14137 webserver.cc:460] Webserver started at http://127.9.61.65:35301/ using document root <none> and password file <none>
I20260929 06:34:02.409742 14137 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:02.409789 14137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:02.409938 14137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:02.411062 14137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "c14ff82cc5cd4680a945aef8f11d7ccb"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "3efd4cd15fc50ae63b91019cd5f1a88b"
server_key_iv: "a90822367d7db80155ddda3f54e7d51b"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.411435 14137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "c14ff82cc5cd4680a945aef8f11d7ccb"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "3efd4cd15fc50ae63b91019cd5f1a88b"
server_key_iv: "a90822367d7db80155ddda3f54e7d51b"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.412894 14137 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:34:02.413705 14151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:02.413856 14137 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:02.413945 14137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "c14ff82cc5cd4680a945aef8f11d7ccb"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "3efd4cd15fc50ae63b91019cd5f1a88b"
server_key_iv: "a90822367d7db80155ddda3f54e7d51b"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.414016 14137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:02.417459 14137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:02.417735 14137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:02.417876 14137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:02.418075 14137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:02.418391 14137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:02.418445 14137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:02.418485 14137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:02.418512 14137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:02.424544 14137 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:36655
I20260929 06:34:02.424587 14264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:36655 every 8 connection(s)
I20260929 06:34:02.424981 14137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:34:02.428192 14117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.425750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:56557 (local address 127.9.61.126:37603)
0929 06:34:02.425815 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.425817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.426121 (+ 304us) server_negotiation.cc:407] Connection header received
0929 06:34:02.426591 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.426592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.426599 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.426657 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:02.427877 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:02.427878 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:02.427878 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:02.427883 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:02.427900 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:02.427904 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:02.427973 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.428117 (+ 144us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.428133 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:34:02.428391 14267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.425751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37603 (local address 127.9.61.65:56557)
0929 06:34:02.425993 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:02.426031 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:02.426505 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:02.426752 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:02.426755 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:02.426763 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:02.427721 (+ 958us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:02.427721 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:02.427753 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:02.427783 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:02.428026 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:02.428031 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:02.428035 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:02.428116 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 06:34:02.428170 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":115,"threads_started":1}
I20260929 06:34:02.428905 14265 heartbeater.cc:347] Connected to a master server at 127.9.61.126:37603
I20260929 06:34:02.429016 14265 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:02.429191 14265 heartbeater.cc:511] Master 127.9.61.126:37603 requested a full tablet report, sending...
I20260929 06:34:02.429692 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 14137
I20260929 06:34:02.429689 14077 ts_manager.cc:194] Registered new tserver with Master: c14ff82cc5cd4680a945aef8f11d7ccb (127.9.61.65:36655)
I20260929 06:34:02.429783 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:34:02.430008 9461 external_mini_cluster.cc:1428] Setting key 14d766fb75ef20cc11bb2bb6ffdb82a1
I20260929 06:34:02.430948 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37603
--builtin_ntp_servers=127.9.61.84:33065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 06:34:02.513816 14268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:02.514038 14268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:02.514061 14268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:02.515180 14268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:02.515264 14268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:02.515300 14268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:34:02.516934 14268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:33065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:02.517148 14268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:02.517397 14268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:02.522485 14276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:02.522480 14273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:02.522501 14274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:02.522867 14268 server_base.cc:1034] running on GCE node
I20260929 06:34:02.523099 14268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:02.523366 14268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:02.524540 14268 hybrid_clock.cc:648] HybridClock initialized: now 1790663642524523 us; error 44 us; skew 500 ppm
I20260929 06:34:02.525892 14268 webserver.cc:460] Webserver started at http://127.9.61.66:40301/ using document root <none> and password file <none>
I20260929 06:34:02.526166 14268 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:02.526243 14268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:02.526398 14268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:02.527503 14268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "cb1921075c684d0ebe6842df0cee915e"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "e4f4233378014f77e51c99a6899bc4b0"
server_key_iv: "528bc36acbb57fe81de1f5cb42c65735"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.527886 14268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "cb1921075c684d0ebe6842df0cee915e"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "e4f4233378014f77e51c99a6899bc4b0"
server_key_iv: "528bc36acbb57fe81de1f5cb42c65735"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.529234 14268 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:02.529942 14282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:02.530102 14268 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:02.530208 14268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "cb1921075c684d0ebe6842df0cee915e"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "e4f4233378014f77e51c99a6899bc4b0"
server_key_iv: "528bc36acbb57fe81de1f5cb42c65735"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.530283 14268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:02.533735 14268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:02.534016 14268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:02.534161 14268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:02.534366 14268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:02.534687 14268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:02.534745 14268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:02.534787 14268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:02.534816 14268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:02.540475 14268 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:39887
I20260929 06:34:02.540541 14395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:39887 every 8 connection(s)
I20260929 06:34:02.540894 14268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:34:02.543882 14117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.541635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:33979 (local address 127.9.61.126:37603)
0929 06:34:02.541705 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.541708 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.541976 (+ 268us) server_negotiation.cc:407] Connection header received
0929 06:34:02.542475 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.542476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.542482 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.542536 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:02.543663 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:02.543664 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:02.543664 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:02.543668 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:02.543682 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:02.543686 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:02.543736 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.543817 (+ 81us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.543829 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:34:02.544148 14398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.541630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37603 (local address 127.9.61.66:33979)
0929 06:34:02.541854 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:02.541889 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:02.542389 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:02.542593 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:02.542597 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:02.542604 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:02.543518 (+ 914us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:02.543519 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:02.543548 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:02.543578 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:02.543749 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:02.543753 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:02.543756 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:34:02.543815 (+ 59us) client_negotiation.cc:240] Negotiation successful
0929 06:34:02.543864 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":99,"threads_started":1}
I20260929 06:34:02.544610 14396 heartbeater.cc:347] Connected to a master server at 127.9.61.126:37603
I20260929 06:34:02.544713 14396 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:02.544883 14396 heartbeater.cc:511] Master 127.9.61.126:37603 requested a full tablet report, sending...
I20260929 06:34:02.545233 14077 ts_manager.cc:194] Registered new tserver with Master: cb1921075c684d0ebe6842df0cee915e (127.9.61.66:39887)
I20260929 06:34:02.545904 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 14268
I20260929 06:34:02.546012 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:34:02.546198 9461 external_mini_cluster.cc:1428] Setting key cede0919522b655dcf36b38ca3b1ee9a
I20260929 06:34:02.547077 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37603
--builtin_ntp_servers=127.9.61.84:33065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260929 06:34:02.628901 14399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:02.629124 14399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:02.629148 14399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:02.630394 14399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:02.630441 14399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:02.630467 14399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:34:02.631877 14399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:33065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:37603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:02.632161 14399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:02.632464 14399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:02.637663 14407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:02.637658 14404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:02.637872 14399 server_base.cc:1034] running on GCE node
W20260929 06:34:02.637658 14405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:02.638157 14399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:02.638422 14399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:02.639590 14399 hybrid_clock.cc:648] HybridClock initialized: now 1790663642639588 us; error 54 us; skew 500 ppm
I20260929 06:34:02.646031 14399 webserver.cc:460] Webserver started at http://127.9.61.67:36251/ using document root <none> and password file <none>
I20260929 06:34:02.646366 14399 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:02.646420 14399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:02.646518 14399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:02.647580 14399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "2751fce5ff7449cb85256df39396715a"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "6aae313bcc79d0963d8d5b8caeecdae6"
server_key_iv: "0763163a722671d378af8278b6fdbdbd"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.647882 14399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "2751fce5ff7449cb85256df39396715a"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "6aae313bcc79d0963d8d5b8caeecdae6"
server_key_iv: "0763163a722671d378af8278b6fdbdbd"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.649241 14399 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:02.649984 14413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:02.650218 14399 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:02.650315 14399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "2751fce5ff7449cb85256df39396715a"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "6aae313bcc79d0963d8d5b8caeecdae6"
server_key_iv: "0763163a722671d378af8278b6fdbdbd"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.650396 14399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:02.653872 14399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:02.654134 14399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:02.654276 14399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:02.654479 14399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:02.654783 14399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:02.654819 14399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:02.654839 14399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:02.654884 14399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:02.660593 14399 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:33423
I20260929 06:34:02.660637 14526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:33423 every 8 connection(s)
I20260929 06:34:02.660964 14399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:34:02.661893 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 14399
I20260929 06:34:02.662009 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:34:02.662191 9461 external_mini_cluster.cc:1428] Setting key 40841b11e653fabc17a771a684c6f0cc
I20260929 06:34:02.664309 14117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.661657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:50117 (local address 127.9.61.126:37603)
0929 06:34:02.661705 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.661707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.662033 (+ 326us) server_negotiation.cc:407] Connection header received
0929 06:34:02.662679 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.662680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.662705 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.662771 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:02.664084 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:02.664085 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:02.664085 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:02.664089 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:02.664102 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:02.664106 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:02.664158 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.664243 (+ 85us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.664257 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:34:02.664487 14529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.661655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:37603 (local address 127.9.61.67:50117)
0929 06:34:02.661896 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:02.661931 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:02.662573 (+ 642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:02.662824 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:02.662827 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:02.662835 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:02.663881 (+ 1046us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:02.663881 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:02.663911 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:02.663995 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:02.664169 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:02.664173 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:02.664175 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:34:02.664238 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 06:34:02.664288 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":140,"threads_started":1}
I20260929 06:34:02.664997 14527 heartbeater.cc:347] Connected to a master server at 127.9.61.126:37603
I20260929 06:34:02.665104 14527 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:02.665257 14527 heartbeater.cc:511] Master 127.9.61.126:37603 requested a full tablet report, sending...
I20260929 06:34:02.665609 14077 ts_manager.cc:194] Registered new tserver with Master: 2751fce5ff7449cb85256df39396715a (127.9.61.67:33423)
I20260929 06:34:02.674438 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:34:02.676964 14117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.675913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57434 (local address 127.9.61.126:37603)
0929 06:34:02.676018 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.676020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.676093 (+ 73us) server_negotiation.cc:407] Connection header received
0929 06:34:02.676140 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.676141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.676145 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.676210 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:02.676762 (+ 552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:02.676763 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:02.676764 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:02.676768 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:02.676785 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:02.676788 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:02.676836 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.676894 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.676908 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260929 06:34:02.678615 14077 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57434:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:34:02.680168 14077 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:34:02.684571 14536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.682583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:33423 (local address 127.0.0.1:47642)
0929 06:34:02.682747 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:02.682782 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:02.682860 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:02.683329 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:02.683330 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:02.683335 (+ 5us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:02.684047 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:02.684048 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:02.684067 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:02.684097 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:02.684383 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:02.684389 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:02.684392 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:34:02.684439 (+ 47us) client_negotiation.cc:240] Negotiation successful
0929 06:34:02.684454 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"spinlock_wait_cycles":896,"thread_start_us":92,"threads_started":1}
I20260929 06:34:02.684805 14540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.682974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38270 (local address 127.9.61.66:39887)
0929 06:34:02.683131 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.683137 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.683148 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:34:02.683178 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.683181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.683192 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.683543 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:02.684278 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:02.684286 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:02.684286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:02.684292 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:02.684331 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:02.684361 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:02.684635 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.684665 (+ 30us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.684683 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260929 06:34:02.685009 14535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.682586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:39887 (local address 127.0.0.1:38270)
0929 06:34:02.682944 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:02.682955 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:02.683000 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:02.683305 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:02.683310 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:02.683318 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:02.684153 (+ 835us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:02.684153 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:02.684178 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:02.684194 (+ 16us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:02.684455 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:02.684456 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:02.684456 (+ 0us) client_negotiation.cc:769] Sending connection context
0929 06:34:02.684493 (+ 37us) client_negotiation.cc:240] Negotiation successful
0929 06:34:02.684507 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":83,"threads_started":1}
I20260929 06:34:02.685031 14537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.682784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47642 (local address 127.9.61.67:33423)
0929 06:34:02.683183 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.683187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.683196 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:02.683222 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.683224 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.683232 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.683543 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:02.684208 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:02.684217 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:02.684218 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:02.684223 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:02.684263 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:02.684298 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:02.684847 (+ 549us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.684919 (+ 72us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.684938 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":89,"threads_started":1}
I20260929 06:34:02.685197 14539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.682946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46924 (local address 127.9.61.65:36655)
0929 06:34:02.683148 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.683153 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.683398 (+ 245us) server_negotiation.cc:407] Connection header received
0929 06:34:02.683430 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.683433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.683445 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.684328 (+ 883us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:02.684789 (+ 461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:02.684796 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:02.684797 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:02.684801 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:02.684833 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:02.684857 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:02.684917 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.685067 (+ 150us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.685082 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":120,"threads_started":1}
I20260929 06:34:02.685786 14330 tablet_service.cc:1467] Processing CreateTablet for tablet 9bb4fc1c911e432ea9f5d21c400583b5 (DEFAULT_TABLE table=test-table [id=0ac85bc3a6de4ec3b3d0f741a71de941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:02.685786 14461 tablet_service.cc:1467] Processing CreateTablet for tablet 9bb4fc1c911e432ea9f5d21c400583b5 (DEFAULT_TABLE table=test-table [id=0ac85bc3a6de4ec3b3d0f741a71de941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:02.686159 14461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bb4fc1c911e432ea9f5d21c400583b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:02.686160 14330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bb4fc1c911e432ea9f5d21c400583b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:02.688052 14538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.682824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:36655 (local address 127.0.0.1:46924)
0929 06:34:02.683274 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:02.683284 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:02.683334 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:02.684144 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:02.684145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:02.684148 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:02.684676 (+ 528us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:02.684676 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:02.684682 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:02.684693 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:02.684944 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:02.684945 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:02.684946 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 06:34:02.684991 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 06:34:02.685003 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":68,"threads_started":1}
I20260929 06:34:02.689697 14542 tablet_bootstrap.cc:492] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e: Bootstrap starting.
I20260929 06:34:02.690507 14542 tablet_bootstrap.cc:654] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:02.690400 14199 tablet_service.cc:1467] Processing CreateTablet for tablet 9bb4fc1c911e432ea9f5d21c400583b5 (DEFAULT_TABLE table=test-table [id=0ac85bc3a6de4ec3b3d0f741a71de941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:02.690825 14199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bb4fc1c911e432ea9f5d21c400583b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:02.690919 14542 log.cc:824] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:02.691296 14541 tablet_bootstrap.cc:492] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a: Bootstrap starting.
I20260929 06:34:02.691933 14541 tablet_bootstrap.cc:654] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:02.692304 14541 log.cc:824] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:02.692907 14542 tablet_bootstrap.cc:492] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e: No bootstrap required, opened a new log
I20260929 06:34:02.692989 14542 ts_tablet_manager.cc:1397] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 06:34:02.693107 14541 tablet_bootstrap.cc:492] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a: No bootstrap required, opened a new log
I20260929 06:34:02.693245 14541 ts_tablet_manager.cc:1397] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:34:02.694422 14545 tablet_bootstrap.cc:492] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb: Bootstrap starting.
I20260929 06:34:02.695225 14545 tablet_bootstrap.cc:654] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:02.695493 14542 raft_consensus.cc:348] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1921075c684d0ebe6842df0cee915e" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39887 } } peers { permanent_uuid: "2751fce5ff7449cb85256df39396715a" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33423 } } peers { permanent_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 36655 } }
I20260929 06:34:02.695683 14542 raft_consensus.cc:374] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:02.695698 14545 log.cc:824] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:02.695734 14542 raft_consensus.cc:729] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1921075c684d0ebe6842df0cee915e, State: Initialized, Role: FOLLOWER
I20260929 06:34:02.695755 14541 raft_consensus.cc:348] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1921075c684d0ebe6842df0cee915e" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39887 } } peers { permanent_uuid: "2751fce5ff7449cb85256df39396715a" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33423 } } peers { permanent_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 36655 } }
I20260929 06:34:02.695879 14542 consensus_queue.cc:260] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1921075c684d0ebe6842df0cee915e" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39887 } } peers { permanent_uuid: "2751fce5ff7449cb85256df39396715a" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33423 } } peers { permanent_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 36655 } }
I20260929 06:34:02.695935 14541 raft_consensus.cc:374] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:02.696012 14541 raft_consensus.cc:729] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2751fce5ff7449cb85256df39396715a, State: Initialized, Role: FOLLOWER
I20260929 06:34:02.696139 14541 consensus_queue.cc:260] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1921075c684d0ebe6842df0cee915e" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39887 } } peers { permanent_uuid: "2751fce5ff7449cb85256df39396715a" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33423 } } peers { permanent_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 36655 } }
I20260929 06:34:02.696169 14542 ts_tablet_manager.cc:1428] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:34:02.696334 14396 heartbeater.cc:503] Master 127.9.61.126:37603 was elected leader, sending a full tablet report...
I20260929 06:34:02.696425 14541 ts_tablet_manager.cc:1428] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:34:02.696470 14527 heartbeater.cc:503] Master 127.9.61.126:37603 was elected leader, sending a full tablet report...
I20260929 06:34:02.696800 14545 tablet_bootstrap.cc:492] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb: No bootstrap required, opened a new log
I20260929 06:34:02.696889 14545 ts_tablet_manager.cc:1397] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:34:02.699013 14545 raft_consensus.cc:348] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1921075c684d0ebe6842df0cee915e" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39887 } } peers { permanent_uuid: "2751fce5ff7449cb85256df39396715a" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33423 } } peers { permanent_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 36655 } }
I20260929 06:34:02.699164 14545 raft_consensus.cc:374] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:02.699210 14545 raft_consensus.cc:729] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c14ff82cc5cd4680a945aef8f11d7ccb, State: Initialized, Role: FOLLOWER
I20260929 06:34:02.699321 14545 consensus_queue.cc:260] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1921075c684d0ebe6842df0cee915e" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39887 } } peers { permanent_uuid: "2751fce5ff7449cb85256df39396715a" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33423 } } peers { permanent_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 36655 } }
I20260929 06:34:02.699589 14545 ts_tablet_manager.cc:1428] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:34:02.699632 14265 heartbeater.cc:503] Master 127.9.61.126:37603 was elected leader, sending a full tablet report...
I20260929 06:34:02.780413 14547 raft_consensus.cc:482] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:34:02.780534 14547 raft_consensus.cc:504] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1921075c684d0ebe6842df0cee915e" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39887 } } peers { permanent_uuid: "2751fce5ff7449cb85256df39396715a" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33423 } } peers { permanent_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 36655 } }
I20260929 06:34:02.780982 14547 leader_election.cc:288] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2751fce5ff7449cb85256df39396715a (127.9.61.67:33423), c14ff82cc5cd4680a945aef8f11d7ccb (127.9.61.65:36655)
I20260929 06:34:02.782250 14539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.781252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:39275 (local address 127.9.61.65:36655)
0929 06:34:02.781296 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.781298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.781308 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:34:02.781335 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.781335 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.781347 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.781417 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:02.782006 (+ 589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:02.782007 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:02.782008 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:02.782013 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:02.782030 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:02.782041 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:02.782106 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.782163 (+ 57us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.782178 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:34:02.782250 14398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.781148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:36655 (local address 127.9.61.66:39275)
0929 06:34:02.781208 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:02.781220 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:02.781261 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:02.781423 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:02.781424 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:02.781427 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:02.781880 (+ 453us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:02.781881 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:02.781888 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:02.781899 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:02.782103 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:02.782104 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:02.782105 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 06:34:02.782161 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 06:34:02.782178 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260929 06:34:02.782683 14219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bb4fc1c911e432ea9f5d21c400583b5" candidate_uuid: "cb1921075c684d0ebe6842df0cee915e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb" is_pre_election: true
I20260929 06:34:02.782864 14219 raft_consensus.cc:2454] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1921075c684d0ebe6842df0cee915e in term 0.
I20260929 06:34:02.782980 14550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.781175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:33423 (local address 127.9.61.66:39775)
0929 06:34:02.781361 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:02.781371 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:02.781459 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:02.781865 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:02.781866 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:02.781880 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:02.782632 (+ 752us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:02.782633 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:02.782640 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:02.782653 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:02.782844 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:02.782844 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:02.782845 (+ 1us) client_negotiation.cc:769] Sending connection context
0929 06:34:02.782891 (+ 46us) client_negotiation.cc:240] Negotiation successful
0929 06:34:02.782905 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":108,"threads_started":1}
I20260929 06:34:02.782986 14537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.781242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:39775 (local address 127.9.61.67:33423)
0929 06:34:02.781300 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.781302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.781448 (+ 146us) server_negotiation.cc:407] Connection header received
0929 06:34:02.781524 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.781525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.781531 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.781586 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:02.782739 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:02.782741 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:02.782741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:02.782745 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:02.782758 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:02.782763 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:02.782812 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.782899 (+ 87us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.782915 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:34:02.783166 14283 leader_election.cc:302] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c14ff82cc5cd4680a945aef8f11d7ccb, cb1921075c684d0ebe6842df0cee915e; no voters:
I20260929 06:34:02.783315 14547 raft_consensus.cc:2781] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:34:02.783414 14547 raft_consensus.cc:482] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:34:02.783453 14547 raft_consensus.cc:3037] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:02.783565 14481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bb4fc1c911e432ea9f5d21c400583b5" candidate_uuid: "cb1921075c684d0ebe6842df0cee915e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2751fce5ff7449cb85256df39396715a" is_pre_election: true
I20260929 06:34:02.783694 14481 raft_consensus.cc:2454] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1921075c684d0ebe6842df0cee915e in term 0.
I20260929 06:34:02.784433 14547 raft_consensus.cc:504] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1921075c684d0ebe6842df0cee915e" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39887 } } peers { permanent_uuid: "2751fce5ff7449cb85256df39396715a" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33423 } } peers { permanent_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 36655 } }
I20260929 06:34:02.784590 14547 leader_election.cc:288] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [CANDIDATE]: Term 1 election: Requested vote from peers 2751fce5ff7449cb85256df39396715a (127.9.61.67:33423), c14ff82cc5cd4680a945aef8f11d7ccb (127.9.61.65:36655)
I20260929 06:34:02.784727 14481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bb4fc1c911e432ea9f5d21c400583b5" candidate_uuid: "cb1921075c684d0ebe6842df0cee915e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2751fce5ff7449cb85256df39396715a"
I20260929 06:34:02.784811 14219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bb4fc1c911e432ea9f5d21c400583b5" candidate_uuid: "cb1921075c684d0ebe6842df0cee915e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb"
I20260929 06:34:02.784849 14481 raft_consensus.cc:3037] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:02.784917 14219 raft_consensus.cc:3037] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:02.785604 14219 raft_consensus.cc:2454] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1921075c684d0ebe6842df0cee915e in term 1.
I20260929 06:34:02.785665 14481 raft_consensus.cc:2454] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1921075c684d0ebe6842df0cee915e in term 1.
I20260929 06:34:02.785841 14286 leader_election.cc:302] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2751fce5ff7449cb85256df39396715a, cb1921075c684d0ebe6842df0cee915e; no voters:
I20260929 06:34:02.785938 14547 raft_consensus.cc:2781] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:02.786092 14547 raft_consensus.cc:686] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 1 LEADER]: Becoming Leader. State: Replica: cb1921075c684d0ebe6842df0cee915e, State: Running, Role: LEADER
I20260929 06:34:02.786222 14547 consensus_queue.cc:237] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1921075c684d0ebe6842df0cee915e" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39887 } } peers { permanent_uuid: "2751fce5ff7449cb85256df39396715a" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33423 } } peers { permanent_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 36655 } }
I20260929 06:34:02.787196 14076 catalog_manager.cc:5495] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1921075c684d0ebe6842df0cee915e (127.9.61.66). New cstate: current_term: 1 leader_uuid: "cb1921075c684d0ebe6842df0cee915e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1921075c684d0ebe6842df0cee915e" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2751fce5ff7449cb85256df39396715a" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 36655 } health_report { overall_health: UNKNOWN } } }
W20260929 06:34:02.791417 14397 tablet.cc:2369] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:34:02.803099 14540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.801960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38282 (local address 127.9.61.66:39887)
0929 06:34:02.802024 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.802026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.802034 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:34:02.802068 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.802069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.802081 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.802141 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:02.802845 (+ 704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:02.802845 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:02.802846 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:02.802849 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:02.802860 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:02.802863 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:02.802905 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:02.802968 (+ 63us) server_negotiation.cc:299] Negotiation successful
0929 06:34:02.802979 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 06:34:02.804975 14481 raft_consensus.cc:1261] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a [term 1 FOLLOWER]: Refusing update from remote peer cb1921075c684d0ebe6842df0cee915e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:02.804993 14219 raft_consensus.cc:1261] T 9bb4fc1c911e432ea9f5d21c400583b5 P c14ff82cc5cd4680a945aef8f11d7ccb [term 1 FOLLOWER]: Refusing update from remote peer cb1921075c684d0ebe6842df0cee915e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:02.805364 14551 consensus_queue.cc:1035] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2751fce5ff7449cb85256df39396715a" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:02.805500 14547 consensus_queue.cc:1035] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c14ff82cc5cd4680a945aef8f11d7ccb" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 36655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:02.811369 14077 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:02.811492 14077 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:02.812320 14077 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fb2526d9c0a54538b848c050f2489765: Sending DeleteTablet for 3 replicas of tablet 9bb4fc1c911e432ea9f5d21c400583b5
I20260929 06:34:02.812646 14330 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bb4fc1c911e432ea9f5d21c400583b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:02 UTC) from {username='slave'} at 127.0.0.1:38270
I20260929 06:34:02.812728 14461 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bb4fc1c911e432ea9f5d21c400583b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:02 UTC) from {username='slave'} at 127.0.0.1:47642
I20260929 06:34:02.812736 14199 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bb4fc1c911e432ea9f5d21c400583b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:02 UTC) from {username='slave'} at 127.0.0.1:46924
I20260929 06:34:02.812862 14565 tablet_replica.cc:330] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e: stopping tablet replica
I20260929 06:34:02.812945 14565 raft_consensus.cc:2229] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:34:02.813073 14565 raft_consensus.cc:2258] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:02.813145 14566 tablet_replica.cc:330] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a: stopping tablet replica
I20260929 06:34:02.813261 14566 raft_consensus.cc:2229] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:02.813367 14566 raft_consensus.cc:2258] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:02.813391 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 14137
I20260929 06:34:02.813555 14565 ts_tablet_manager.cc:1905] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:02.813789 14566 ts_tablet_manager.cc:1905] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:02.815263 14565 ts_tablet_manager.cc:1918] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:02.815332 14565 log.cc:1196] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/9bb4fc1c911e432ea9f5d21c400583b5
I20260929 06:34:02.815603 14565 ts_tablet_manager.cc:1939] T 9bb4fc1c911e432ea9f5d21c400583b5 P cb1921075c684d0ebe6842df0cee915e: Deleting consensus metadata
I20260929 06:34:02.815749 14566 ts_tablet_manager.cc:1918] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:02.815816 14566 log.cc:1196] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/9bb4fc1c911e432ea9f5d21c400583b5
I20260929 06:34:02.816044 14061 catalog_manager.cc:4841] TS cb1921075c684d0ebe6842df0cee915e (127.9.61.66:39887): tablet 9bb4fc1c911e432ea9f5d21c400583b5 (table test-table [id=0ac85bc3a6de4ec3b3d0f741a71de941]) successfully deleted
I20260929 06:34:02.816306 14566 ts_tablet_manager.cc:1939] T 9bb4fc1c911e432ea9f5d21c400583b5 P 2751fce5ff7449cb85256df39396715a: Deleting consensus metadata
I20260929 06:34:02.816766 14064 catalog_manager.cc:4841] TS 2751fce5ff7449cb85256df39396715a (127.9.61.67:33423): tablet 9bb4fc1c911e432ea9f5d21c400583b5 (table test-table [id=0ac85bc3a6de4ec3b3d0f741a71de941]) successfully deleted
W20260929 06:34:02.820801 14061 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:36655 (error 108)
I20260929 06:34:02.821004 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 14268
I20260929 06:34:02.821930 14538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.821776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:36655 (local address 127.0.0.1:46928)
0929 06:34:02.821842 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:02.821887 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:36655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 06:34:02.822057 14061 catalog_manager.cc:4584] TS c14ff82cc5cd4680a945aef8f11d7ccb (127.9.61.65:36655): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9bb4fc1c911e432ea9f5d21c400583b5: Network error: Client connection negotiation failed: client connection to 127.9.61.65:36655: connect: Connection refused (error 111)
I20260929 06:34:02.826022 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 14399
I20260929 06:34:02.830830 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 14046
2026-09-29T06:34:02Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (685 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260929 06:34:02.850518 9461 mini_oidc.cc:152] Starting JWKS server
I20260929 06:34:02.851639 9461 webserver.cc:460] Webserver started at https://127.0.0.1:35047/ using document root <none> and password file <none>
I20260929 06:34:02.851766 9461 mini_oidc.cc:189] Starting OIDC Discovery server
I20260929 06:34:02.852049 9461 webserver.cc:460] Webserver started at http://127.0.0.1:46017/ using document root <none> and password file <none>
2026-09-29T06:34:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:02Z Disabled control of system clock
I20260929 06:34:02.859658 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41553
--webserver_interface=127.9.61.126
--webserver_port=0
--builtin_ntp_servers=127.9.61.84:34737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:41553
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35047/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/testchainca.cert with env {}
W20260929 06:34:02.942454 14574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:02.942701 14574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:02.942726 14574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:02.943907 14574 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:02.944002 14574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:02.944031 14574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:02.944060 14574 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:02.944074 14574 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 06:34:02.944087 14574 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 06:34:02.944104 14574 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35047/jwks.json
I20260929 06:34:02.945690 14574 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:41553
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35047/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:02.945909 14574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:02.946080 14574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:02.951638 14582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:02.951787 14574 server_base.cc:1034] running on GCE node
W20260929 06:34:02.951647 14579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:02.951905 14580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:02.952180 14574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:02.952493 14574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:02.953675 14574 hybrid_clock.cc:648] HybridClock initialized: now 1790663642953653 us; error 40 us; skew 500 ppm
I20260929 06:34:02.955024 14574 webserver.cc:460] Webserver started at http://127.9.61.126:36963/ using document root <none> and password file <none>
I20260929 06:34:02.955286 14574 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:02.955354 14574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:02.955500 14574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:02.956658 14574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "b97dc98a5d9e49f5a551d7c1606c0e63"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "383e5df6747337390775b6a8ee575a46"
server_key_iv: "45d22f8db8471e3dde3e4c3a5955f79c"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.957042 14574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "b97dc98a5d9e49f5a551d7c1606c0e63"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "383e5df6747337390775b6a8ee575a46"
server_key_iv: "45d22f8db8471e3dde3e4c3a5955f79c"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.958379 14574 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:34:02.959129 14588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:02.959311 14574 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:02.959417 14574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "b97dc98a5d9e49f5a551d7c1606c0e63"
format_stamp: "Formatted at 2026-09-29 06:34:02 on dist-test-slave-601b"
server_key: "383e5df6747337390775b6a8ee575a46"
server_key_iv: "45d22f8db8471e3dde3e4c3a5955f79c"
server_key_version: "encryptionkey@0"
I20260929 06:34:02.959494 14574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:02.981532 14574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:02.981913 14574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:02.982079 14574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:02.986378 14574 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:41553
I20260929 06:34:02.986418 14640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:41553 every 8 connection(s)
I20260929 06:34:02.986783 14574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:02.987833 14641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:02.990212 14641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63: Bootstrap starting.
I20260929 06:34:02.990770 14641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:02.991003 14641 log.cc:824] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:02.991688 14641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63: No bootstrap required, opened a new log
I20260929 06:34:02.993350 14641 raft_consensus.cc:348] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97dc98a5d9e49f5a551d7c1606c0e63" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41553 } }
I20260929 06:34:02.993498 14641 raft_consensus.cc:374] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:02.993521 14641 raft_consensus.cc:729] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b97dc98a5d9e49f5a551d7c1606c0e63, State: Initialized, Role: FOLLOWER
I20260929 06:34:02.993630 14641 consensus_queue.cc:260] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97dc98a5d9e49f5a551d7c1606c0e63" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41553 } }
I20260929 06:34:02.993714 14641 raft_consensus.cc:388] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:02.993754 14641 raft_consensus.cc:482] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:02.993831 14641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:02.994455 14641 raft_consensus.cc:504] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97dc98a5d9e49f5a551d7c1606c0e63" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41553 } }
I20260929 06:34:02.994511 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 14574
I20260929 06:34:02.994577 14641 leader_election.cc:302] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b97dc98a5d9e49f5a551d7c1606c0e63; no voters:
I20260929 06:34:02.994618 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:02.994777 14641 leader_election.cc:288] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:02.994827 9461 external_mini_cluster.cc:1428] Setting key 121477dc5e591d132d5f9c82c47d706c
I20260929 06:34:02.994853 14644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:02.995009 14644 raft_consensus.cc:686] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [term 1 LEADER]: Becoming Leader. State: Replica: b97dc98a5d9e49f5a551d7c1606c0e63, State: Running, Role: LEADER
I20260929 06:34:02.995043 14641 sys_catalog.cc:564] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:02.995112 14644 consensus_queue.cc:237] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97dc98a5d9e49f5a551d7c1606c0e63" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41553 } }
I20260929 06:34:02.996333 14645 sys_catalog.cc:455] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b97dc98a5d9e49f5a551d7c1606c0e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97dc98a5d9e49f5a551d7c1606c0e63" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41553 } } }
I20260929 06:34:02.996424 14645 sys_catalog.cc:458] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:02.996628 14646 sys_catalog.cc:455] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b97dc98a5d9e49f5a551d7c1606c0e63. Latest consensus state: current_term: 1 leader_uuid: "b97dc98a5d9e49f5a551d7c1606c0e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97dc98a5d9e49f5a551d7c1606c0e63" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41553 } } }
I20260929 06:34:02.996688 14646 sys_catalog.cc:458] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63 [sys.catalog]: This master's current role is: LEADER
W20260929 06:34:02.997140 14661 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:34:02.997206 14661 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:34:02.997265 14662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:02.997432 14662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:02.998905 14662 catalog_manager.cc:1347] Generated new cluster ID: 6cb07b33458d4acdb501a8356ff12509
I20260929 06:34:02.998958 14662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:34:03.001682 14654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:02.995568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57684 (local address 127.9.61.126:41553)
0929 06:34:02.996139 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:02.996148 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:02.996185 (+ 37us) server_negotiation.cc:407] Connection header received
0929 06:34:02.996310 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:02.996319 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:02.996393 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:02.996604 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:02.996827 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:02.998275 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:02.999337 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.000032 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.000172 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:03.000931 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:03.000936 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:03.000936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:03.001160 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:03.001205 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:03.001221 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:03.001294 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:03.001362 (+ 68us) server_negotiation.cc:299] Negotiation successful
0929 06:34:03.001448 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":477,"thread_start_us":459,"threads_started":1}
I20260929 06:34:03.002701 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:34:03.017036 14662 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:03.017617 14662 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:03.023307 14662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b97dc98a5d9e49f5a551d7c1606c0e63: Generated new TSK 0
I20260929 06:34:03.023537 14662 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260929 06:34:03.058462 14671 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260929 06:34:03.058593 14671 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260929 06:34:03.059113 14670 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:03.039366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41553 (local address 127.0.0.1:57694)
0929 06:34:03.039585 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:03.039597 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:03.039680 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:03.039899 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:03.039900 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:03.039902 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0929 06:34:03.040002 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:03.040005 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.040667 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.040668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:03.041633 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:03.041636 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.041977 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.041978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:03.042049 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:03.042073 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 06:34:03.058774 (+ 16701us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35047/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0929 06:34:03.058864 (+ 90us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.61.126:41553: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35047/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":114,"threads_started":1}
I20260929 06:34:03.059430 14654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:03.039426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57694 (local address 127.9.61.126:41553)
0929 06:34:03.039498 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:03.039500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:03.039668 (+ 168us) server_negotiation.cc:407] Connection header received
0929 06:34:03.039788 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:03.039789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:03.039800 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:03.039880 (+ 80us) server_negotiation.cc:226] Negotiated authn=JWT
0929 06:34:03.040074 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.040565 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.041723 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.041903 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.041955 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:03.042188 (+ 233us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 06:34:03.058581 (+ 16393us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35047/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0929 06:34:03.059368 (+ 787us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57694: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35047/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":40}
W20260929 06:34:03.059479 14654 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57694: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35047/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.9.61.126:41553: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35047/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260929 06:34:03.059607 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 14574
2026-09-29T06:34:03Z chronyd exiting
I20260929 06:34:03.095690 9461 test_util.cc:175] -----------------------------------------------
I20260929 06:34:03.095803 9461 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790663621200347-9461-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (246 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260929 06:34:03.096621 9461 mini_oidc.cc:152] Starting JWKS server
I20260929 06:34:03.097378 9461 webserver.cc:460] Webserver started at https://127.0.0.1:34721/ using document root <none> and password file <none>
I20260929 06:34:03.097450 9461 mini_oidc.cc:189] Starting OIDC Discovery server
I20260929 06:34:03.097609 9461 webserver.cc:460] Webserver started at http://127.0.0.1:35889/ using document root <none> and password file <none>
2026-09-29T06:34:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:03Z Disabled control of system clock
I20260929 06:34:03.105683 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:44939
--webserver_interface=127.9.61.126
--webserver_port=0
--builtin_ntp_servers=127.9.61.84:45551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:44939
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34721/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/testchainca.cert with env {}
W20260929 06:34:03.187419 14677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:03.187666 14677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:03.187691 14677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:03.188923 14677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:03.188970 14677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:03.188983 14677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:03.188995 14677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:03.189007 14677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 06:34:03.189019 14677 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 06:34:03.189030 14677 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34721/jwks.json
I20260929 06:34:03.190704 14677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:45551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:44939
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:44939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34721/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:03.190928 14677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:03.191111 14677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:03.196019 14682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:03.196038 14685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:03.196014 14683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:03.196408 14677 server_base.cc:1034] running on GCE node
I20260929 06:34:03.196627 14677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:03.196939 14677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:03.198096 14677 hybrid_clock.cc:648] HybridClock initialized: now 1790663643198063 us; error 45 us; skew 500 ppm
I20260929 06:34:03.199416 14677 webserver.cc:460] Webserver started at http://127.9.61.126:39585/ using document root <none> and password file <none>
I20260929 06:34:03.199669 14677 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:03.199754 14677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:03.199885 14677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:03.201053 14677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "940305ce56c24cde805bf3ad60aa29b5"
format_stamp: "Formatted at 2026-09-29 06:34:03 on dist-test-slave-601b"
server_key: "fcf78e334320f2cab1eb1e399471ea2a"
server_key_iv: "79c13c8157e2830b9880c859dcaa7334"
server_key_version: "encryptionkey@0"
I20260929 06:34:03.201367 14677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "940305ce56c24cde805bf3ad60aa29b5"
format_stamp: "Formatted at 2026-09-29 06:34:03 on dist-test-slave-601b"
server_key: "fcf78e334320f2cab1eb1e399471ea2a"
server_key_iv: "79c13c8157e2830b9880c859dcaa7334"
server_key_version: "encryptionkey@0"
I20260929 06:34:03.202661 14677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:34:03.203424 14691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:03.203629 14677 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:03.203740 14677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "940305ce56c24cde805bf3ad60aa29b5"
format_stamp: "Formatted at 2026-09-29 06:34:03 on dist-test-slave-601b"
server_key: "fcf78e334320f2cab1eb1e399471ea2a"
server_key_iv: "79c13c8157e2830b9880c859dcaa7334"
server_key_version: "encryptionkey@0"
I20260929 06:34:03.203821 14677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:03.221448 14677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:03.221835 14677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:03.222016 14677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:03.226258 14677 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:44939
I20260929 06:34:03.226312 14743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:44939 every 8 connection(s)
I20260929 06:34:03.226697 14677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:03.227751 14744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:03.230036 14744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5: Bootstrap starting.
I20260929 06:34:03.230475 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 14677
I20260929 06:34:03.230582 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:03.230779 14744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:03.230799 9461 external_mini_cluster.cc:1428] Setting key d6dda419690ad8e09bc13413be5bc000
I20260929 06:34:03.231093 14744 log.cc:824] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:03.231904 14744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5: No bootstrap required, opened a new log
I20260929 06:34:03.234156 14744 raft_consensus.cc:348] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "940305ce56c24cde805bf3ad60aa29b5" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 44939 } }
I20260929 06:34:03.234326 14744 raft_consensus.cc:374] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:03.234357 14744 raft_consensus.cc:729] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 940305ce56c24cde805bf3ad60aa29b5, State: Initialized, Role: FOLLOWER
I20260929 06:34:03.234483 14744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "940305ce56c24cde805bf3ad60aa29b5" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 44939 } }
I20260929 06:34:03.234576 14744 raft_consensus.cc:388] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:03.234625 14744 raft_consensus.cc:482] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:03.234673 14744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:03.235309 14744 raft_consensus.cc:504] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "940305ce56c24cde805bf3ad60aa29b5" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 44939 } }
I20260929 06:34:03.235425 14744 leader_election.cc:302] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 940305ce56c24cde805bf3ad60aa29b5; no voters:
I20260929 06:34:03.235610 14744 leader_election.cc:288] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:03.235751 14749 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:03.235918 14749 raft_consensus.cc:686] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [term 1 LEADER]: Becoming Leader. State: Replica: 940305ce56c24cde805bf3ad60aa29b5, State: Running, Role: LEADER
I20260929 06:34:03.235900 14744 sys_catalog.cc:564] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:03.236106 14749 consensus_queue.cc:237] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "940305ce56c24cde805bf3ad60aa29b5" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 44939 } }
I20260929 06:34:03.236470 14750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "940305ce56c24cde805bf3ad60aa29b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "940305ce56c24cde805bf3ad60aa29b5" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 44939 } } }
I20260929 06:34:03.236570 14750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:03.236480 14751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 940305ce56c24cde805bf3ad60aa29b5. Latest consensus state: current_term: 1 leader_uuid: "940305ce56c24cde805bf3ad60aa29b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "940305ce56c24cde805bf3ad60aa29b5" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 44939 } } }
I20260929 06:34:03.236717 14751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:03.236828 14756 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:03.236968 14748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:03.231308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59378 (local address 127.9.61.126:44939)
0929 06:34:03.231518 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:03.231528 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:03.231562 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:34:03.232133 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:03.232141 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:03.232204 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:03.232329 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:03.232561 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.233407 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.234610 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.235120 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.235218 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:03.236059 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:03.236064 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:03.236064 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:03.236284 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:03.236326 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:03.236341 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:03.236381 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:03.236614 (+ 233us) server_negotiation.cc:299] Negotiation successful
0929 06:34:03.236718 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":60,"threads_started":1}
I20260929 06:34:03.237592 14756 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:03.238235 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:34:03.239282 14756 catalog_manager.cc:1347] Generated new cluster ID: 9d0561079cd242608b55e8f1b1d25e3f
I20260929 06:34:03.239333 14756 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:34:03.256690 14756 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:03.257475 14756 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:03.265601 14756 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 940305ce56c24cde805bf3ad60aa29b5: Generated new TSK 0
I20260929 06:34:03.265826 14756 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260929 06:34:03.291154 14774 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260929 06:34:03.291258 14774 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260929 06:34:03.291594 14748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:03.277137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59388 (local address 127.9.61.126:44939)
0929 06:34:03.277182 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:03.277184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:03.277294 (+ 110us) server_negotiation.cc:407] Connection header received
0929 06:34:03.277339 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:03.277340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:03.277353 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:03.277436 (+ 83us) server_negotiation.cc:226] Negotiated authn=JWT
0929 06:34:03.277566 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.278364 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.279119 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.279433 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.279505 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:03.279655 (+ 150us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 06:34:03.291362 (+ 11707us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34721/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0929 06:34:03.291517 (+ 155us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59388: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34721/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":24}
W20260929 06:34:03.291658 14748 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59388: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34721/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260929 06:34:03.291699 14773 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:03.277051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:44939 (local address 127.0.0.1:59388)
0929 06:34:03.277214 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:03.277224 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:03.277288 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:03.277440 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:03.277441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:03.277442 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0929 06:34:03.277497 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:03.277498 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.278453 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.278454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:03.279031 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:03.279033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.279513 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.279514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:03.279555 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:03.279560 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 06:34:03.291481 (+ 11921us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34721/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0929 06:34:03.291596 (+ 115us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.61.126:44939: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34721/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":106,"threads_started":1}
I20260929 06:34:03.292111 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 14677
2026-09-29T06:34:03Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (233 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260929 06:34:03.329733 9461 mini_oidc.cc:152] Starting JWKS server
I20260929 06:34:03.330435 9461 webserver.cc:460] Webserver started at https://127.0.0.1:41377/ using document root <none> and password file <none>
I20260929 06:34:03.330478 9461 mini_oidc.cc:189] Starting OIDC Discovery server
I20260929 06:34:03.330643 9461 webserver.cc:460] Webserver started at http://127.0.0.1:40237/ using document root <none> and password file <none>
2026-09-29T06:34:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:03Z Disabled control of system clock
I20260929 06:34:03.338160 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:38189
--webserver_interface=127.9.61.126
--webserver_port=0
--builtin_ntp_servers=127.9.61.84:38241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:38189
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41377/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260929 06:34:03.417899 14780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:03.418115 14780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:03.418138 14780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:03.419209 14780 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:03.419245 14780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:03.419257 14780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:03.419269 14780 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:03.419281 14780 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 06:34:03.419293 14780 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 06:34:03.419304 14780 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41377/jwks.json
I20260929 06:34:03.420614 14780 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:38241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:38189
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:38189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41377/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:03.420800 14780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:03.421026 14780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:03.425701 14788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:03.425701 14785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:03.425714 14786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:03.426039 14780 server_base.cc:1034] running on GCE node
I20260929 06:34:03.426280 14780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:03.426518 14780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:03.427680 14780 hybrid_clock.cc:648] HybridClock initialized: now 1790663643427664 us; error 29 us; skew 500 ppm
I20260929 06:34:03.428900 14780 webserver.cc:460] Webserver started at http://127.9.61.126:42909/ using document root <none> and password file <none>
I20260929 06:34:03.429176 14780 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:03.429251 14780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:03.429402 14780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:03.430466 14780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "86109a77ae7e47d19effdbd10f295147"
format_stamp: "Formatted at 2026-09-29 06:34:03 on dist-test-slave-601b"
server_key: "f196521f93285d09c1661e39f4927ca3"
server_key_iv: "95748a937faaadd99d7f9d9435d11f0c"
server_key_version: "encryptionkey@0"
I20260929 06:34:03.430823 14780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "86109a77ae7e47d19effdbd10f295147"
format_stamp: "Formatted at 2026-09-29 06:34:03 on dist-test-slave-601b"
server_key: "f196521f93285d09c1661e39f4927ca3"
server_key_iv: "95748a937faaadd99d7f9d9435d11f0c"
server_key_version: "encryptionkey@0"
I20260929 06:34:03.432188 14780 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:34:03.432957 14794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:03.433135 14780 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:03.433239 14780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "86109a77ae7e47d19effdbd10f295147"
format_stamp: "Formatted at 2026-09-29 06:34:03 on dist-test-slave-601b"
server_key: "f196521f93285d09c1661e39f4927ca3"
server_key_iv: "95748a937faaadd99d7f9d9435d11f0c"
server_key_version: "encryptionkey@0"
I20260929 06:34:03.433319 14780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:03.452081 14780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:03.452420 14780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:03.452579 14780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:03.456410 14780 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:38189
I20260929 06:34:03.456445 14846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:38189 every 8 connection(s)
I20260929 06:34:03.456822 14780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:03.457479 14847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:03.460161 14847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147: Bootstrap starting.
I20260929 06:34:03.460685 14847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:03.460919 14847 log.cc:824] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:03.461524 14847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147: No bootstrap required, opened a new log
I20260929 06:34:03.462291 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 14780
I20260929 06:34:03.462402 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:03.462571 9461 external_mini_cluster.cc:1428] Setting key dbbc7835b9027723eb4c3413deb85689
I20260929 06:34:03.463618 14847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86109a77ae7e47d19effdbd10f295147" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38189 } }
I20260929 06:34:03.463776 14847 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:03.463819 14847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86109a77ae7e47d19effdbd10f295147, State: Initialized, Role: FOLLOWER
I20260929 06:34:03.463975 14847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86109a77ae7e47d19effdbd10f295147" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38189 } }
I20260929 06:34:03.464071 14847 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:03.464107 14847 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:03.464159 14847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:03.464699 14847 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86109a77ae7e47d19effdbd10f295147" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38189 } }
I20260929 06:34:03.464784 14847 leader_election.cc:302] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86109a77ae7e47d19effdbd10f295147; no voters:
I20260929 06:34:03.464960 14847 leader_election.cc:288] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:03.465000 14852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:03.465114 14852 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [term 1 LEADER]: Becoming Leader. State: Replica: 86109a77ae7e47d19effdbd10f295147, State: Running, Role: LEADER
I20260929 06:34:03.465198 14852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86109a77ae7e47d19effdbd10f295147" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38189 } }
I20260929 06:34:03.465232 14847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:03.465584 14854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86109a77ae7e47d19effdbd10f295147. Latest consensus state: current_term: 1 leader_uuid: "86109a77ae7e47d19effdbd10f295147" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86109a77ae7e47d19effdbd10f295147" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38189 } } }
I20260929 06:34:03.465621 14853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86109a77ae7e47d19effdbd10f295147" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86109a77ae7e47d19effdbd10f295147" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38189 } } }
I20260929 06:34:03.465763 14854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:03.465777 14853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:03.466117 14861 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:03.466590 14861 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:03.468410 14861 catalog_manager.cc:1347] Generated new cluster ID: 55872e35d9e54f85ae2e7f76a9cbfd42
I20260929 06:34:03.468466 14861 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:34:03.469192 14851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:03.463107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42534 (local address 127.9.61.126:38189)
0929 06:34:03.463309 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:03.463315 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:03.463340 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:34:03.463603 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:03.463610 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:03.463675 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:03.463820 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:03.464037 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.465754 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.467014 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.467531 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.467651 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:03.468409 (+ 758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:03.468413 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:03.468413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:03.468649 (+ 236us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:03.468683 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:03.468695 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:03.468777 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:03.468857 (+ 80us) server_negotiation.cc:299] Negotiation successful
0929 06:34:03.469030 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
I20260929 06:34:03.475632 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:34:03.480216 14861 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:03.480732 14861 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:03.488649 14861 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86109a77ae7e47d19effdbd10f295147: Generated new TSK 0
I20260929 06:34:03.488864 14861 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:34:03.498796 14851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:03.495160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42548 (local address 127.9.61.126:38189)
0929 06:34:03.495207 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:03.495208 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:03.495296 (+ 88us) server_negotiation.cc:407] Connection header received
0929 06:34:03.495377 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:03.495377 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:03.495387 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:03.495448 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0929 06:34:03.495602 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.496154 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.497288 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.497486 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.497542 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:03.497736 (+ 194us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 06:34:03.498549 (+ 813us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41377/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0929 06:34:03.498713 (+ 164us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42548: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41377/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 06:34:03.498869 14851 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42548: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41377/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260929 06:34:03.498875 14876 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:03.495097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38189 (local address 127.0.0.1:42548)
0929 06:34:03.495245 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:03.495255 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:03.495313 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:03.495472 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:03.495473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:03.495475 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0929 06:34:03.495531 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:03.495533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.496240 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.496241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:03.497199 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:03.497202 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.497572 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.497573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:03.497637 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:03.497642 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 06:34:03.498672 (+ 1030us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41377/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0929 06:34:03.498761 (+ 89us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.61.126:38189: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41377/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":89,"threads_started":1}
I20260929 06:34:03.499217 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 14780
E20260929 06:34:03.510097 14877 webserver.cc:533] Webserver: sslize failed:
E20260929 06:34:03.510170 14877 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-09-29T06:34:03Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (206 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-29T06:34:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:03Z Disabled control of system clock
I20260929 06:34:03.543665 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:36607
--webserver_interface=127.9.61.126
--webserver_port=0
--builtin_ntp_servers=127.9.61.84:37185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:36607
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/testchainca.cert with env {}
W20260929 06:34:03.623988 14881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:03.624195 14881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:03.624218 14881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:03.625319 14881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:03.625352 14881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:03.625365 14881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:03.625377 14881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:03.625389 14881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260929 06:34:03.625401 14881 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260929 06:34:03.625412 14881 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260929 06:34:03.626873 14881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:37185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:36607
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:36607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:03.627067 14881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:03.627291 14881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:03.632113 14887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:03.632148 14889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:03.632123 14886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:03.632390 14881 server_base.cc:1034] running on GCE node
I20260929 06:34:03.632637 14881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:03.632921 14881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:03.634078 14881 hybrid_clock.cc:648] HybridClock initialized: now 1790663643634052 us; error 44 us; skew 500 ppm
I20260929 06:34:03.635330 14881 webserver.cc:460] Webserver started at http://127.9.61.126:42663/ using document root <none> and password file <none>
I20260929 06:34:03.635592 14881 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:03.635639 14881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:03.635807 14881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:03.636895 14881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "9c5ba4df864e475991c8abae84b17503"
format_stamp: "Formatted at 2026-09-29 06:34:03 on dist-test-slave-601b"
server_key: "70bcd74d4b497f4199c0e09ee6c96e8d"
server_key_iv: "5915b79e115d0bf8405224507a762a95"
server_key_version: "encryptionkey@0"
I20260929 06:34:03.637254 14881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "9c5ba4df864e475991c8abae84b17503"
format_stamp: "Formatted at 2026-09-29 06:34:03 on dist-test-slave-601b"
server_key: "70bcd74d4b497f4199c0e09ee6c96e8d"
server_key_iv: "5915b79e115d0bf8405224507a762a95"
server_key_version: "encryptionkey@0"
I20260929 06:34:03.638527 14881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:34:03.639300 14895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:03.639482 14881 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:03.639585 14881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "9c5ba4df864e475991c8abae84b17503"
format_stamp: "Formatted at 2026-09-29 06:34:03 on dist-test-slave-601b"
server_key: "70bcd74d4b497f4199c0e09ee6c96e8d"
server_key_iv: "5915b79e115d0bf8405224507a762a95"
server_key_version: "encryptionkey@0"
I20260929 06:34:03.639669 14881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:03.655746 14881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:03.656118 14881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:03.656276 14881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:03.660238 14881 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:36607
I20260929 06:34:03.660277 14947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:36607 every 8 connection(s)
I20260929 06:34:03.660620 14881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:03.661533 14948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:03.663686 14948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503: Bootstrap starting.
I20260929 06:34:03.664294 14948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:03.664523 14948 log.cc:824] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:03.665118 14948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503: No bootstrap required, opened a new log
I20260929 06:34:03.666605 14948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c5ba4df864e475991c8abae84b17503" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36607 } }
I20260929 06:34:03.666735 14948 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:03.666757 14948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c5ba4df864e475991c8abae84b17503, State: Initialized, Role: FOLLOWER
I20260929 06:34:03.666891 14948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c5ba4df864e475991c8abae84b17503" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36607 } }
I20260929 06:34:03.666975 14948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:03.666997 14948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:03.667025 14948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:03.667526 14948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c5ba4df864e475991c8abae84b17503" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36607 } }
I20260929 06:34:03.667609 14948 leader_election.cc:302] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c5ba4df864e475991c8abae84b17503; no voters:
I20260929 06:34:03.667748 14948 leader_election.cc:288] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:03.667778 14951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:03.667904 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 14881
I20260929 06:34:03.667963 14951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [term 1 LEADER]: Becoming Leader. State: Replica: 9c5ba4df864e475991c8abae84b17503, State: Running, Role: LEADER
I20260929 06:34:03.668032 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:03.668030 14948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:03.668115 14951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c5ba4df864e475991c8abae84b17503" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36607 } }
I20260929 06:34:03.668253 9461 external_mini_cluster.cc:1428] Setting key 5a96fd676163556bb3eacab4cce344a7
I20260929 06:34:03.668416 14951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c5ba4df864e475991c8abae84b17503. Latest consensus state: current_term: 1 leader_uuid: "9c5ba4df864e475991c8abae84b17503" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c5ba4df864e475991c8abae84b17503" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36607 } } }
I20260929 06:34:03.668503 14951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:03.668421 14953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c5ba4df864e475991c8abae84b17503" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c5ba4df864e475991c8abae84b17503" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36607 } } }
I20260929 06:34:03.668639 14953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:03.668824 14958 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:03.669412 14958 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:03.671030 14958 catalog_manager.cc:1347] Generated new cluster ID: c9c2c7f782c340be9def516cff0b7f07
I20260929 06:34:03.671084 14958 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:34:03.675272 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:03.668984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60778 (local address 127.9.61.126:36607)
0929 06:34:03.669306 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:03.669315 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:03.669581 (+ 266us) server_negotiation.cc:407] Connection header received
0929 06:34:03.670013 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:03.670021 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:03.670093 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:03.670243 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:03.670567 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.671990 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.673072 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.673679 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.673795 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:03.674497 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:03.674501 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:03.674501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:03.674702 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:03.674741 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:03.674754 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:03.674814 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:03.674912 (+ 98us) server_negotiation.cc:299] Negotiation successful
0929 06:34:03.675075 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":81,"threads_started":1}
I20260929 06:34:03.677204 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:34:03.687656 14958 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:03.688405 14958 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:03.692975 14958 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c5ba4df864e475991c8abae84b17503: Generated new TSK 0
I20260929 06:34:03.693153 14958 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:34:03.811853 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:03.702288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60794 (local address 127.9.61.126:36607)
0929 06:34:03.702350 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:03.702352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:03.702486 (+ 134us) server_negotiation.cc:407] Connection header received
0929 06:34:03.702557 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:03.702558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:03.702577 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:03.702636 (+ 59us) server_negotiation.cc:226] Negotiated authn=JWT
0929 06:34:03.702781 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.703270 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.704417 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.704613 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.704672 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:03.704849 (+ 177us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0929 06:34:03.811623 (+106774us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0929 06:34:03.811791 (+ 168us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60794: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":37}
W20260929 06:34:03.811921 14963 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60794: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260929 06:34:03.812229 14977 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:03.702233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36607 (local address 127.0.0.1:60794)
0929 06:34:03.702409 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:03.702420 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:03.702490 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:03.702651 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:03.702652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:03.702654 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0929 06:34:03.702717 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:03.702719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.703349 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.703350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:03.704339 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:03.704342 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:03.704691 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:03.704692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:03.704751 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:03.704757 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0929 06:34:03.811805 (+107048us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0929 06:34:03.812140 (+ 335us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.61.126:36607: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":111,"threads_started":1}
I20260929 06:34:03.812561 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 14881
2026-09-29T06:34:03Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (293 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (87 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (90 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:34:04 dist-test-slave-601b krb5kdc[14989](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:34:04 dist-test-slave-601b krb5kdc[14989](info): set up 2 sockets
Sep 29 06:34:04 dist-test-slave-601b krb5kdc[14989](info): commencing operation
krb5kdc: starting...
W20260929 06:34:05.016342 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:34:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:34:05.134387 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:39367
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:40019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:39367
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:05.217018 15002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:05.217267 15002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:05.217291 15002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:05.218453 15002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:05.218492 15002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:05.218506 15002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:05.218519 15002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:05.218532 15002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:05.220080 15002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:40019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:39367
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:39367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:05.220302 15002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:05.220494 15002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:05.225366 15010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:05.225368 15007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:05.225370 15008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:05.225571 15002 server_base.cc:1034] running on GCE node
I20260929 06:34:05.225811 15002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:05.226104 15002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:05.227260 15002 hybrid_clock.cc:648] HybridClock initialized: now 1790663645227239 us; error 37 us; skew 500 ppm
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:05.229836 15002 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:34:05.230243 15002 webserver.cc:460] Webserver started at http://127.9.61.126:33735/ using document root <none> and password file <none>
I20260929 06:34:05.230479 15002 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:05.230549 15002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:05.230706 15002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:05.231804 15002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "7bd8bef4749740dfac20c92642a9257f"
format_stamp: "Formatted at 2026-09-29 06:34:05 on dist-test-slave-601b"
server_key: "61d5d71c5a3f8b4bd9c673ab1df99ad6"
server_key_iv: "17ad2489119dc86b45c1c810443c701a"
server_key_version: "encryptionkey@0"
I20260929 06:34:05.232216 15002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "7bd8bef4749740dfac20c92642a9257f"
format_stamp: "Formatted at 2026-09-29 06:34:05 on dist-test-slave-601b"
server_key: "61d5d71c5a3f8b4bd9c673ab1df99ad6"
server_key_iv: "17ad2489119dc86b45c1c810443c701a"
server_key_version: "encryptionkey@0"
I20260929 06:34:05.233615 15002 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:05.234479 15017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:05.234673 15002 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:05.234782 15002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "7bd8bef4749740dfac20c92642a9257f"
format_stamp: "Formatted at 2026-09-29 06:34:05 on dist-test-slave-601b"
server_key: "61d5d71c5a3f8b4bd9c673ab1df99ad6"
server_key_iv: "17ad2489119dc86b45c1c810443c701a"
server_key_version: "encryptionkey@0"
I20260929 06:34:05.234861 15002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:05.245273 15002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:05.247315 15002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:05.247488 15002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:05.251572 15002 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:39367
I20260929 06:34:05.251609 15069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:39367 every 8 connection(s)
I20260929 06:34:05.252005 15002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:05.252919 15070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:05.255239 15070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f: Bootstrap starting.
I20260929 06:34:05.255846 15070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:05.256188 15070 log.cc:824] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:05.256933 15070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f: No bootstrap required, opened a new log
I20260929 06:34:05.258648 15070 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd8bef4749740dfac20c92642a9257f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39367 } }
I20260929 06:34:05.258824 15070 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:05.258852 15070 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bd8bef4749740dfac20c92642a9257f, State: Initialized, Role: FOLLOWER
I20260929 06:34:05.259024 15070 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd8bef4749740dfac20c92642a9257f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39367 } }
I20260929 06:34:05.259095 15070 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:05.259119 15070 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:05.259188 15070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:05.259429 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 15002
I20260929 06:34:05.259534 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:05.259744 9461 external_mini_cluster.cc:1428] Setting key 4bfffd367015a161f3ec598137d3b0fc
I20260929 06:34:05.259877 15070 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd8bef4749740dfac20c92642a9257f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39367 } }
I20260929 06:34:05.260053 15070 leader_election.cc:302] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bd8bef4749740dfac20c92642a9257f; no voters:
I20260929 06:34:05.260251 15070 leader_election.cc:288] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:05.260473 15073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:05.260583 15070 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:05.260646 15073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [term 1 LEADER]: Becoming Leader. State: Replica: 7bd8bef4749740dfac20c92642a9257f, State: Running, Role: LEADER
I20260929 06:34:05.260782 15073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd8bef4749740dfac20c92642a9257f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39367 } }
I20260929 06:34:05.261149 15073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bd8bef4749740dfac20c92642a9257f. Latest consensus state: current_term: 1 leader_uuid: "7bd8bef4749740dfac20c92642a9257f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd8bef4749740dfac20c92642a9257f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39367 } } }
I20260929 06:34:05.261257 15073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:05.261750 15083 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:05.261900 15077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7bd8bef4749740dfac20c92642a9257f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd8bef4749740dfac20c92642a9257f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39367 } } }
I20260929 06:34:05.261991 15077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:05.262404 15083 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:05.265180 15083 catalog_manager.cc:1347] Generated new cluster ID: a455c311a788419fbfe5ed868343dd2b
I20260929 06:34:05.265244 15083 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:05.271445 15075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:05.260291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44776 (local address 127.9.61.126:39367)
0929 06:34:05.260529 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:05.260539 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:05.260582 (+ 43us) server_negotiation.cc:407] Connection header received
0929 06:34:05.260726 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:05.260734 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:05.260793 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:05.260951 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:05.261826 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.263242 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.264312 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.264942 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.265061 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:05.267563 (+ 2502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:05.267567 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:05.267567 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:05.267586 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:05.269803 (+ 2217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.270211 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.270223 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.270223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.270324 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.270556 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.270556 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.270557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.270811 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:05.271004 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:05.271074 (+ 70us) server_negotiation.cc:299] Negotiation successful
0929 06:34:05.271219 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":109,"threads_started":1}
I20260929 06:34:05.287673 15083 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:05.288347 15083 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:05.295356 15083 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7bd8bef4749740dfac20c92642a9257f: Generated new TSK 0
I20260929 06:34:05.295583 15083 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:34:05.326028 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39367
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:40019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:05.419065 15096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:05.419293 15096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:05.419320 15096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:05.420585 15096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:05.420637 15096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:05.420666 15096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:34:05.422276 15096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:40019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:05.422565 15096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:05.422808 15096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:05.427964 15101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:05.427912 15102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:05.428149 15096 server_base.cc:1034] running on GCE node
W20260929 06:34:05.427970 15104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:05.428416 15096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:05.428692 15096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:05.429863 15096 hybrid_clock.cc:648] HybridClock initialized: now 1790663645429854 us; error 42 us; skew 500 ppm
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:05.432595 15096 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:34:05.433121 15096 webserver.cc:460] Webserver started at http://127.9.61.65:35063/ using document root <none> and password file <none>
I20260929 06:34:05.433374 15096 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:05.433445 15096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:05.433601 15096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:05.434736 15096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "c28a2ee2733249d7ba658f388b886cec"
format_stamp: "Formatted at 2026-09-29 06:34:05 on dist-test-slave-601b"
server_key: "2404a45387a26491067a8f87e569492f"
server_key_iv: "779bbb71921d79d6a4a2516e792e39d0"
server_key_version: "encryptionkey@0"
I20260929 06:34:05.435106 15096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "c28a2ee2733249d7ba658f388b886cec"
format_stamp: "Formatted at 2026-09-29 06:34:05 on dist-test-slave-601b"
server_key: "2404a45387a26491067a8f87e569492f"
server_key_iv: "779bbb71921d79d6a4a2516e792e39d0"
server_key_version: "encryptionkey@0"
I20260929 06:34:05.436535 15096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:34:05.437243 15111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:05.437409 15096 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:05.437515 15096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "c28a2ee2733249d7ba658f388b886cec"
format_stamp: "Formatted at 2026-09-29 06:34:05 on dist-test-slave-601b"
server_key: "2404a45387a26491067a8f87e569492f"
server_key_iv: "779bbb71921d79d6a4a2516e792e39d0"
server_key_version: "encryptionkey@0"
I20260929 06:34:05.437625 15096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:05.459007 15096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:05.461244 15096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:05.461421 15096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:05.461704 15096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:05.462086 15096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:05.462147 15096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:05.462193 15096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:05.462221 15096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:05.467998 15096 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:40305
I20260929 06:34:05.468039 15224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:40305 every 8 connection(s)
I20260929 06:34:05.468374 15096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:34:05.471844 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 15096
I20260929 06:34:05.471992 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:34:05.472267 9461 external_mini_cluster.cc:1428] Setting key 0e2e8e79ad884ebb2c50a5adcf436305
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:05.479092 15075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:05.469185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:45153 (local address 127.9.61.126:39367)
0929 06:34:05.469263 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:05.469265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:05.469503 (+ 238us) server_negotiation.cc:407] Connection header received
0929 06:34:05.470589 (+ 1086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:05.470590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:05.470601 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:05.470671 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:05.471318 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.471876 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.473342 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.473543 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.473613 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:05.475988 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:05.475990 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:05.475990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:05.476007 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:05.477608 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.478073 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.478075 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.478076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.478143 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.478406 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.478407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.478407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.478527 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:05.478608 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:05.478894 (+ 286us) server_negotiation.cc:299] Negotiation successful
0929 06:34:05.478984 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260929 06:34:05.479449 15227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:05.469179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:39367 (local address 127.9.61.65:45153)
0929 06:34:05.469361 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:05.469405 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:05.470331 (+ 926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:05.470755 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:05.470758 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:05.471030 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:05.471224 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:05.471228 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.472121 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.472122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:05.473236 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:05.473239 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.473636 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.473637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:05.473797 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:05.474442 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:05.474452 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:05.475859 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:05.477726 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:05.477735 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:05.477737 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:05.477987 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:05.478215 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:05.478216 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:05.478216 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:05.478338 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:05.478599 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:05.478606 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:05.478760 (+ 154us) client_negotiation.cc:769] Sending connection context
0929 06:34:05.478872 (+ 112us) client_negotiation.cc:240] Negotiation successful
0929 06:34:05.479041 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":106,"threads_started":1}
I20260929 06:34:05.479993 15225 heartbeater.cc:347] Connected to a master server at 127.9.61.126:39367
I20260929 06:34:05.480119 15225 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:05.480329 15225 heartbeater.cc:511] Master 127.9.61.126:39367 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
I20260929 06:34:05.480950 15034 ts_manager.cc:194] Registered new tserver with Master: c28a2ee2733249d7ba658f388b886cec (127.9.61.65:40305)
I20260929 06:34:05.481627 15034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:45153
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:34:05.498399 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39367
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:40019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:05.579154 15230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:05.579388 15230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:05.579414 15230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:05.580742 15230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:05.580798 15230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:05.580828 15230 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:34:05.582329 15230 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:40019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:05.582532 15230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:05.582722 15230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:34:05.588181 15230 server_base.cc:1034] running on GCE node
W20260929 06:34:05.588111 15236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:05.588127 15235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:05.588117 15238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:05.588546 15230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:05.588819 15230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:05.589977 15230 hybrid_clock.cc:648] HybridClock initialized: now 1790663645589968 us; error 33 us; skew 500 ppm
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:05.592655 15230 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:34:05.593183 15230 webserver.cc:460] Webserver started at http://127.9.61.66:35413/ using document root <none> and password file <none>
I20260929 06:34:05.593417 15230 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:05.593484 15230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:05.593639 15230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:05.594733 15230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "c3b3dff41b3e406ea34cd43fe36fa834"
format_stamp: "Formatted at 2026-09-29 06:34:05 on dist-test-slave-601b"
server_key: "d7d09d39fd94c0f2db635971a3689bb8"
server_key_iv: "017687f6303f6309bb23e82aaf72e189"
server_key_version: "encryptionkey@0"
I20260929 06:34:05.595134 15230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "c3b3dff41b3e406ea34cd43fe36fa834"
format_stamp: "Formatted at 2026-09-29 06:34:05 on dist-test-slave-601b"
server_key: "d7d09d39fd94c0f2db635971a3689bb8"
server_key_iv: "017687f6303f6309bb23e82aaf72e189"
server_key_version: "encryptionkey@0"
I20260929 06:34:05.596571 15230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:34:05.597373 15245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:05.597565 15230 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:05.597673 15230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "c3b3dff41b3e406ea34cd43fe36fa834"
format_stamp: "Formatted at 2026-09-29 06:34:05 on dist-test-slave-601b"
server_key: "d7d09d39fd94c0f2db635971a3689bb8"
server_key_iv: "017687f6303f6309bb23e82aaf72e189"
server_key_version: "encryptionkey@0"
I20260929 06:34:05.597750 15230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:05.633518 15230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:05.635567 15230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:05.635741 15230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:05.636050 15230 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:05.636402 15230 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:05.636458 15230 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:05.636503 15230 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:05.636530 15230 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:05.643023 15230 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:34393
I20260929 06:34:05.643071 15358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:34393 every 8 connection(s)
I20260929 06:34:05.643455 15230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:34:05.644025 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 15230
I20260929 06:34:05.644174 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:34:05.644371 9461 external_mini_cluster.cc:1428] Setting key fdfab713d7beead8f149735b8942b192
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
I20260929 06:34:05.655835 15075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:05.644625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:39773 (local address 127.9.61.126:39367)
0929 06:34:05.644682 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:05.644685 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:05.644696 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:34:05.646015 (+ 1319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:05.646016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:05.646026 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:05.646075 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:05.647183 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.648007 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.649786 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.649977 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.650064 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:05.652801 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:05.652803 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:05.652803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:05.652812 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:05.654332 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.654818 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.654819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.654820 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.654882 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.655146 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.655147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.655148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.655266 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:05.655341 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:05.655678 (+ 337us) server_negotiation.cc:299] Negotiation successful
0929 06:34:05.655758 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:34:05.656098 15361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:05.644315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:39367 (local address 127.9.61.66:39773)
0929 06:34:05.644531 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:05.644587 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:05.645890 (+ 1303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:05.646217 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:05.646223 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:05.646699 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:05.647035 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:05.647041 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.648107 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.648108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:05.649682 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:05.649686 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.650074 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.650075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:05.650217 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:05.650869 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:05.650879 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:05.652685 (+ 1806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:05.654424 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:05.654432 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:05.654434 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:05.654738 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:05.654951 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:05.654952 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:05.654952 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:05.655075 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:05.655341 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:05.655348 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:05.655526 (+ 178us) client_negotiation.cc:769] Sending connection context
0929 06:34:05.655652 (+ 126us) client_negotiation.cc:240] Negotiation successful
0929 06:34:05.655804 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":100,"threads_started":1}
I20260929 06:34:05.656715 15359 heartbeater.cc:347] Connected to a master server at 127.9.61.126:39367
I20260929 06:34:05.656869 15359 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
I20260929 06:34:05.657116 15359 heartbeater.cc:511] Master 127.9.61.126:39367 requested a full tablet report, sending...
I20260929 06:34:05.657599 15034 ts_manager.cc:194] Registered new tserver with Master: c3b3dff41b3e406ea34cd43fe36fa834 (127.9.61.66:34393)
I20260929 06:34:05.658113 15034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:39773
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:34:05.672932 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39367
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:40019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:05.756255 15364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:05.756481 15364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:05.756507 15364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:05.757643 15364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:05.757678 15364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:05.757702 15364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:34:05.759065 15364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:40019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:05.759258 15364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:05.759433 15364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:05.764689 15372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:05.764709 15369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:05.764700 15370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:05.764966 15364 server_base.cc:1034] running on GCE node
I20260929 06:34:05.765257 15364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:05.765511 15364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:05.766680 15364 hybrid_clock.cc:648] HybridClock initialized: now 1790663645766675 us; error 38 us; skew 500 ppm
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:05.769268 15364 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:34:05.769728 15364 webserver.cc:460] Webserver started at http://127.9.61.67:43785/ using document root <none> and password file <none>
I20260929 06:34:05.769958 15364 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:05.770027 15364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:05.770190 15364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:05.771273 15364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "e0b22310782a4b0fa409e7e9a8c0cd1d"
format_stamp: "Formatted at 2026-09-29 06:34:05 on dist-test-slave-601b"
server_key: "59834ad5142bf0d03bc25661da40d9fb"
server_key_iv: "567c284945eec684823ad208d0faaef4"
server_key_version: "encryptionkey@0"
I20260929 06:34:05.771643 15364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "e0b22310782a4b0fa409e7e9a8c0cd1d"
format_stamp: "Formatted at 2026-09-29 06:34:05 on dist-test-slave-601b"
server_key: "59834ad5142bf0d03bc25661da40d9fb"
server_key_iv: "567c284945eec684823ad208d0faaef4"
server_key_version: "encryptionkey@0"
I20260929 06:34:05.773093 15364 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:34:05.773857 15379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:05.774061 15364 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:05.774192 15364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "e0b22310782a4b0fa409e7e9a8c0cd1d"
format_stamp: "Formatted at 2026-09-29 06:34:05 on dist-test-slave-601b"
server_key: "59834ad5142bf0d03bc25661da40d9fb"
server_key_iv: "567c284945eec684823ad208d0faaef4"
server_key_version: "encryptionkey@0"
I20260929 06:34:05.774272 15364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:05.791451 15364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:05.794049 15364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:05.794236 15364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:05.794507 15364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:05.794837 15364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:05.794895 15364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:05.794941 15364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:05.794986 15364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:05.801198 15364 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:36623
I20260929 06:34:05.801261 15492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:36623 every 8 connection(s)
I20260929 06:34:05.801589 15364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:34:05.808076 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 15364
I20260929 06:34:05.808166 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:05.808338 9461 external_mini_cluster.cc:1428] Setting key 73a960ff3e01dafa11e87c4bf06af3d1
I20260929 06:34:05.811707 15075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:05.802420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:54851 (local address 127.9.61.126:39367)
0929 06:34:05.802502 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:05.802504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:05.802689 (+ 185us) server_negotiation.cc:407] Connection header received
0929 06:34:05.803697 (+ 1008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:05.803698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:05.803708 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:05.803765 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:05.804510 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.805042 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.806134 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.806328 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.806385 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:05.808823 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:05.808825 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:05.808826 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:05.808834 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:05.810223 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.810688 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.810689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.810690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.810754 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.811012 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.811013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.811013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.811140 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:05.811217 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:05.811527 (+ 310us) server_negotiation.cc:299] Negotiation successful
0929 06:34:05.811607 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260929 06:34:05.811977 15495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:05.802367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:39367 (local address 127.9.61.67:54851)
0929 06:34:05.802557 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:05.802597 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:05.803591 (+ 994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:05.803826 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:05.803829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:05.804197 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:05.804400 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:05.804405 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.805167 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.805168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:05.806040 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:05.806042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.806406 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.806407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:05.806511 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:05.807068 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:05.807078 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:05.808712 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:05.810338 (+ 1626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:05.810346 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:05.810348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:05.810598 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:05.810823 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:05.810824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:05.810824 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:05.810940 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:05.811220 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:05.811226 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:05.811386 (+ 160us) client_negotiation.cc:769] Sending connection context
0929 06:34:05.811495 (+ 109us) client_negotiation.cc:240] Negotiation successful
0929 06:34:05.811678 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":98,"threads_started":1}
I20260929 06:34:05.812459 15493 heartbeater.cc:347] Connected to a master server at 127.9.61.126:39367
I20260929 06:34:05.812580 15493 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:05.812772 15493 heartbeater.cc:511] Master 127.9.61.126:39367 requested a full tablet report, sending...
I20260929 06:34:05.813174 15034 ts_manager.cc:194] Registered new tserver with Master: e0b22310782a4b0fa409e7e9a8c0cd1d (127.9.61.67:36623)
I20260929 06:34:05.813580 15034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:54851
I20260929 06:34:05.820266 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/test-admin.keytab.
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:05.836980 9461 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260929 06:34:05.838894 15500 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:05.838073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44538 (local address 127.9.61.65:40305)
0929 06:34:05.838264 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:05.838269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:05.838278 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:05.838306 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:05.838308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:05.838322 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:05.838391 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:05.838790 (+ 399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44538: BlockingRecv error: recv got EOF from 127.0.0.1:44538 (error 108)
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":112,"threads_started":1}
W20260929 06:34:05.838989 9461 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/krb5cc)
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:05.840162 9461 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:05.841140 9461 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.65@KRBTEST.COM
I20260929 06:34:05.848955 15500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:05.841728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44544 (local address 127.9.61.65:40305)
0929 06:34:05.841789 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:05.841791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:05.841804 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:34:05.841879 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:05.841880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:05.841889 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:05.841937 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:05.842299 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.843024 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.843726 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.844114 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.844173 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:05.846233 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:05.846241 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:05.846242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:05.846249 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:05.847872 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.848224 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.848227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.848227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.848283 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.848436 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.848437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.848437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.848556 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:05.848664 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:05.848724 (+ 60us) server_negotiation.cc:299] Negotiation successful
0929 06:34:05.848784 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260929 06:34:05.850898 15500 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:05.850293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44546 (local address 127.9.61.65:40305)
0929 06:34:05.850329 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:05.850331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:05.850404 (+ 73us) server_negotiation.cc:407] Connection header received
0929 06:34:05.850472 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:05.850473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:05.850489 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:05.850561 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:05.850853 (+ 292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44546: BlockingRecv error: recv got EOF from 127.0.0.1:44546 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 06:34:05.851047 9461 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/krb5cc' of type FILE
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:05.852280 9461 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:05.853252 9461 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.65@KRBTEST.COM
I20260929 06:34:05.860423 15500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:05.853807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44560 (local address 127.9.61.65:40305)
0929 06:34:05.853844 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:05.853847 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:05.853878 (+ 31us) server_negotiation.cc:407] Connection header received
0929 06:34:05.853931 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:05.853931 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:05.853941 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:05.854010 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:05.854351 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.854893 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.855578 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.855790 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.855850 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:05.857961 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:05.857962 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:05.857962 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:05.857969 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:05.859391 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.859685 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.859685 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.859685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.859727 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.859867 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.859868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.859868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.860039 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:05.860137 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:05.860295 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 06:34:05.860355 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 06:34:05.862169 15500 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:05.861602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44576 (local address 127.9.61.65:40305)
0929 06:34:05.861664 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:05.861666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:05.861697 (+ 31us) server_negotiation.cc:407] Connection header received
0929 06:34:05.861746 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:05.861746 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:05.861754 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:05.861797 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:05.862119 (+ 322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44576: BlockingRecv error: recv got EOF from 127.0.0.1:44576 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260929 06:34:05.862268 9461 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790663621200347-9461-0/krb5kdc/krb5cc' of type FILE
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:05.863317 9461 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:05.864225 9461 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[14989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.65@KRBTEST.COM
I20260929 06:34:05.871140 15500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:05.864729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44592 (local address 127.9.61.65:40305)
0929 06:34:05.864787 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:05.864788 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:05.864805 (+ 17us) server_negotiation.cc:407] Connection header received
0929 06:34:05.864855 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:05.864857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:05.864865 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:05.864909 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:05.865237 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.865720 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.866382 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:05.866555 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:05.866612 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:05.868822 (+ 2210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:05.868824 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:05.868824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:05.868830 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:05.870020 (+ 1190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.870322 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.870323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.870323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.870371 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:05.870528 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:05.870529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:05.870529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:05.870616 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:05.870686 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:05.870784 (+ 98us) server_negotiation.cc:299] Negotiation successful
0929 06:34:05.870852 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 06:34:05.871887 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 15096
I20260929 06:34:05.877619 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 15230
I20260929 06:34:05.882254 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 15364
I20260929 06:34:05.886682 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 15002
2026-09-29T06:34:05Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1898 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[15513](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[15513](info): set up 2 sockets
Sep 29 06:34:05 dist-test-slave-601b krb5kdc[15513](info): commencing operation
krb5kdc: starting...
W20260929 06:34:06.924182 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:34:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:07Z Disabled control of system clock
WARNING: no policy specified for oryx/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.126.keytab.
Entry for principal oryx/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.126.keytab.
I20260929 06:34:07.038719 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:36609
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.126.keytab
--principal=oryx/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:36609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:07.119694 15526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:07.119946 15526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:07.120009 15526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:07.121171 15526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:07.121248 15526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:07.121270 15526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:07.121291 15526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:07.121322 15526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:07.122769 15526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:36609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.126.keytab
--principal=oryx/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:36609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:07.123060 15526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:07.123286 15526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:07.128166 15534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:07.128166 15532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:07.128194 15531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:07.128296 15526 server_base.cc:1034] running on GCE node
I20260929 06:34:07.128737 15526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:07.129025 15526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:07.130195 15526 hybrid_clock.cc:648] HybridClock initialized: now 1790663647130194 us; error 40 us; skew 500 ppm
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:07.132750 15526 init.cc:377] Logged in from keytab as oryx/127.9.61.126@KRBTEST.COM (short username oryx)
I20260929 06:34:07.133129 15526 webserver.cc:460] Webserver started at http://127.9.61.126:40537/ using document root <none> and password file <none>
I20260929 06:34:07.133303 15526 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:07.133343 15526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:07.133432 15526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:07.134436 15526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "bbb5a97e6390d3b47445bf280db1af1c"
server_key_iv: "404b089676f6c0bc868ef08e8a1ef958"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.134732 15526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "bbb5a97e6390d3b47445bf280db1af1c"
server_key_iv: "404b089676f6c0bc868ef08e8a1ef958"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.136031 15526 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:34:07.136713 15541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.136865 15526 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:07.136950 15526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "bbb5a97e6390d3b47445bf280db1af1c"
server_key_iv: "404b089676f6c0bc868ef08e8a1ef958"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.137003 15526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:07.150239 15526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:07.152547 15526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:07.152659 15526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:07.156414 15526 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:36609
I20260929 06:34:07.156464 15593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:36609 every 8 connection(s)
I20260929 06:34:07.156814 15526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:07.157859 15594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:07.160181 15594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20: Bootstrap starting.
I20260929 06:34:07.160769 15594 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:07.161058 15594 log.cc:824] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:07.161748 15594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20: No bootstrap required, opened a new log
I20260929 06:34:07.163082 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 15526
I20260929 06:34:07.163166 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:07.163369 9461 external_mini_cluster.cc:1428] Setting key 919f835449baf99e5e6f9502279b8536
I20260929 06:34:07.163414 15594 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } }
I20260929 06:34:07.163628 15594 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:07.163672 15594 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7f3c408f0a443a8ad3a77e3f4cf2e20, State: Initialized, Role: FOLLOWER
I20260929 06:34:07.163882 15594 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } }
I20260929 06:34:07.164031 15594 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:07.164090 15594 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:07.164148 15594 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:07.165036 15594 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } }
I20260929 06:34:07.165158 15594 leader_election.cc:302] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7f3c408f0a443a8ad3a77e3f4cf2e20; no voters:
I20260929 06:34:07.165355 15594 leader_election.cc:288] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:07.165387 15599 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:07.165510 15599 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 1 LEADER]: Becoming Leader. State: Replica: f7f3c408f0a443a8ad3a77e3f4cf2e20, State: Running, Role: LEADER
I20260929 06:34:07.165627 15594 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:07.165676 15599 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } }
I20260929 06:34:07.166075 15599 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7f3c408f0a443a8ad3a77e3f4cf2e20. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } }
I20260929 06:34:07.166345 15599 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:07.166266 15601 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } }
I20260929 06:34:07.166783 15601 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:07.166785 15608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:07.167354 15608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:07.168898 15608 catalog_manager.cc:1347] Generated new cluster ID: b1f9418de52a4e44a14261bfd7785b5f
I20260929 06:34:07.168957 15608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:07.174762 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.163910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33072 (local address 127.9.61.126:36609)
0929 06:34:07.164156 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:07.164165 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:07.164200 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:34:07.164366 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:07.164371 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:07.164417 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:07.164552 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:07.165186 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.166511 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.167571 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.168199 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.168309 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.171113 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:07.171117 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:07.171117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:07.171129 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:07.173121 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.173534 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.173537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.173537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.173649 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.173894 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.173895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.173895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.174179 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:07.174323 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:07.174445 (+ 122us) server_negotiation.cc:299] Negotiation successful
0929 06:34:07.174572 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":111,"threads_started":1}
I20260929 06:34:07.183413 15608 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:07.184008 15608 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:07.186198 15608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20: Generated new TSK 0
I20260929 06:34:07.186359 15608 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab.
Entry for principal oryx/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab.
I20260929 06:34:07.215337 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:36609
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab
--principal=oryx/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:07.296097 15620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:07.296325 15620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:07.296362 15620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:07.297508 15620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:07.297578 15620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:07.297623 15620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:34:07.299120 15620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab
--principal=oryx/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:36609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:07.299391 15620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:07.299626 15620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:07.304808 15628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:07.304819 15625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:07.304836 15626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:07.305081 15620 server_base.cc:1034] running on GCE node
I20260929 06:34:07.305294 15620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:07.305531 15620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:07.306694 15620 hybrid_clock.cc:648] HybridClock initialized: now 1790663647306679 us; error 28 us; skew 500 ppm
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:07.309381 15620 init.cc:377] Logged in from keytab as oryx/127.9.61.65@KRBTEST.COM (short username oryx)
I20260929 06:34:07.309842 15620 webserver.cc:460] Webserver started at http://127.9.61.65:46627/ using document root <none> and password file <none>
I20260929 06:34:07.310034 15620 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:07.310082 15620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:07.310173 15620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:07.311167 15620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "ef697f01324e4f65854299d26cd23035"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "a9b6b001a3ac1bf550fb1343ad14895b"
server_key_iv: "cd508930d3cb74661f3dc63dcbe249d7"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.311467 15620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "ef697f01324e4f65854299d26cd23035"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "a9b6b001a3ac1bf550fb1343ad14895b"
server_key_iv: "cd508930d3cb74661f3dc63dcbe249d7"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.312829 15620 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:34:07.313541 15635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.313720 15620 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:07.313788 15620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "ef697f01324e4f65854299d26cd23035"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "a9b6b001a3ac1bf550fb1343ad14895b"
server_key_iv: "cd508930d3cb74661f3dc63dcbe249d7"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.313840 15620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:07.327714 15620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:07.330127 15620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:07.330236 15620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:07.330410 15620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:07.330714 15620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:07.330747 15620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.330792 15620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:07.330817 15620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.336462 15620 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:43577
I20260929 06:34:07.336539 15748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:43577 every 8 connection(s)
I20260929 06:34:07.336858 15620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:34:07.340250 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 15620
I20260929 06:34:07.340359 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:34:07.340596 9461 external_mini_cluster.cc:1428] Setting key 839c9a2b898631df7ad13969873ea371
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:07.347524 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.337649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:39155 (local address 127.9.61.126:36609)
0929 06:34:07.337710 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:07.337712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:07.337922 (+ 210us) server_negotiation.cc:407] Connection header received
0929 06:34:07.338476 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:07.338477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:07.338495 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:07.338557 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:07.339623 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.340222 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.341581 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.341788 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.341888 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.344566 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:07.344567 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:07.344567 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:07.344574 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:07.346004 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.346521 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.346521 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.346522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.346572 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.346868 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.346869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.346869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.346965 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:07.347048 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:07.347388 (+ 340us) server_negotiation.cc:299] Negotiation successful
0929 06:34:07.347454 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:34:07.347813 15751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.337625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.65:39155)
0929 06:34:07.337793 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:07.337836 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:07.338346 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:07.338630 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:07.338634 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:07.339255 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:07.339523 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.339529 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.340316 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.340317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.341478 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.341481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.341896 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.341897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.342033 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.342594 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:07.342606 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:07.344450 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:07.346089 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.346096 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.346099 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.346439 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.346644 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.346645 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.346645 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.346798 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.347065 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:07.347071 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:07.347241 (+ 170us) client_negotiation.cc:769] Sending connection context
0929 06:34:07.347363 (+ 122us) client_negotiation.cc:240] Negotiation successful
0929 06:34:07.347555 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
I20260929 06:34:07.348428 15749 heartbeater.cc:347] Connected to a master server at 127.9.61.126:36609
I20260929 06:34:07.348532 15749 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:07.348727 15749 heartbeater.cc:511] Master 127.9.61.126:36609 requested a full tablet report, sending...
I20260929 06:34:07.349313 15558 ts_manager.cc:194] Registered new tserver with Master: ef697f01324e4f65854299d26cd23035 (127.9.61.65:43577)
WARNING: no policy specified for oryx/127.9.61.66@KRBTEST.COM; defaulting to no policy
I20260929 06:34:07.349862 15558 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:39155
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab.
Entry for principal oryx/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab.
I20260929 06:34:07.367720 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:36609
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab
--principal=oryx/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:07.449143 15754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:07.449404 15754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:07.449441 15754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:07.450603 15754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:07.450670 15754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:07.450716 15754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:34:07.452201 15754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab
--principal=oryx/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:36609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:07.452466 15754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:07.452690 15754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:07.457909 15760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:07.458045 15754 server_base.cc:1034] running on GCE node
W20260929 06:34:07.457921 15762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:07.457917 15759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:07.458323 15754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:07.458550 15754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:07.459704 15754 hybrid_clock.cc:648] HybridClock initialized: now 1790663647459700 us; error 36 us; skew 500 ppm
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:07.462176 15754 init.cc:377] Logged in from keytab as oryx/127.9.61.66@KRBTEST.COM (short username oryx)
I20260929 06:34:07.462601 15754 webserver.cc:460] Webserver started at http://127.9.61.66:41519/ using document root <none> and password file <none>
I20260929 06:34:07.462832 15754 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:07.462899 15754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:07.463044 15754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:07.464139 15754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "64a5b1fcee224070b0ef36b33985af23"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "1a695cb63fa1d627f81fc1a8d85113dc"
server_key_iv: "9a4feff7b6c12201766d5fa686ede8aa"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.464501 15754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "64a5b1fcee224070b0ef36b33985af23"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "1a695cb63fa1d627f81fc1a8d85113dc"
server_key_iv: "9a4feff7b6c12201766d5fa686ede8aa"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.465917 15754 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:34:07.466652 15769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.466842 15754 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:07.466962 15754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "64a5b1fcee224070b0ef36b33985af23"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "1a695cb63fa1d627f81fc1a8d85113dc"
server_key_iv: "9a4feff7b6c12201766d5fa686ede8aa"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.467047 15754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:07.481671 15754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:07.483922 15754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:07.484108 15754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:07.484282 15754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:07.484596 15754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:07.484629 15754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.484680 15754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:07.484709 15754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.490281 15754 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:40579
I20260929 06:34:07.490365 15882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:40579 every 8 connection(s)
I20260929 06:34:07.490676 15754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:34:07.492322 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 15754
I20260929 06:34:07.492434 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:34:07.492652 9461 external_mini_cluster.cc:1428] Setting key 3043769c158bfc0dd235eb82f27b39f6
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
WARNING: no policy specified for oryx/127.9.61.67@KRBTEST.COM; defaulting to no policy
I20260929 06:34:07.501248 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.491417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:58863 (local address 127.9.61.126:36609)
0929 06:34:07.491465 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:07.491472 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:07.491677 (+ 205us) server_negotiation.cc:407] Connection header received
0929 06:34:07.492184 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:07.492185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:07.492198 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:07.492282 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:07.493494 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.494245 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.495643 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.495832 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.495899 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.498337 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:07.498339 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:07.498340 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:07.498347 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:07.499765 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.500236 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.500238 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.500238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.500300 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.500562 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.500563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.500563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.500672 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:07.500742 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:07.501098 (+ 356us) server_negotiation.cc:299] Negotiation successful
0929 06:34:07.501181 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:34:07.501415 15885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.491363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.66:58863)
0929 06:34:07.491540 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:07.491582 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:07.492069 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:07.492337 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:07.492341 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:07.493128 (+ 787us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:07.493394 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.493401 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.494334 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.494334 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.495538 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.495541 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.495925 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.495926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.496101 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.496620 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:07.496631 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:07.498227 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:07.499871 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.499878 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.499880 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.500158 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.500369 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.500370 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.500370 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.500482 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.500744 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:07.500751 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:07.500904 (+ 153us) client_negotiation.cc:769] Sending connection context
0929 06:34:07.501025 (+ 121us) client_negotiation.cc:240] Negotiation successful
0929 06:34:07.501206 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
I20260929 06:34:07.501909 15883 heartbeater.cc:347] Connected to a master server at 127.9.61.126:36609
I20260929 06:34:07.502002 15883 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:07.502143 15883 heartbeater.cc:511] Master 127.9.61.126:36609 requested a full tablet report, sending...
I20260929 06:34:07.502501 15558 ts_manager.cc:194] Registered new tserver with Master: 64a5b1fcee224070b0ef36b33985af23 (127.9.61.66:40579)
I20260929 06:34:07.503041 15558 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:58863
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab.
Entry for principal oryx/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab.
I20260929 06:34:07.516804 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:36609
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab
--principal=oryx/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:07.596915 15888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:07.597169 15888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:07.597208 15888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:07.598369 15888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:07.598444 15888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:07.598487 15888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:34:07.600066 15888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab
--principal=oryx/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:36609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:07.600320 15888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:07.600553 15888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:07.605566 15893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:07.605583 15894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:07.605835 15888 server_base.cc:1034] running on GCE node
W20260929 06:34:07.605583 15896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:07.606076 15888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:07.606313 15888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:07.607478 15888 hybrid_clock.cc:648] HybridClock initialized: now 1790663647607481 us; error 45 us; skew 500 ppm
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:07.610014 15888 init.cc:377] Logged in from keytab as oryx/127.9.61.67@KRBTEST.COM (short username oryx)
I20260929 06:34:07.610462 15888 webserver.cc:460] Webserver started at http://127.9.61.67:44335/ using document root <none> and password file <none>
I20260929 06:34:07.610737 15888 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:07.610800 15888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:07.610934 15888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:07.612032 15888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "d5a59bfd5d004b008443bda693c91543"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "d954ddfea77a294ddc3a47cc4e038008"
server_key_iv: "ba8cc15f9d543a0b36eef8f9b228a505"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.612413 15888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "d5a59bfd5d004b008443bda693c91543"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "d954ddfea77a294ddc3a47cc4e038008"
server_key_iv: "ba8cc15f9d543a0b36eef8f9b228a505"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.613773 15888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:07.614524 15903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.614696 15888 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:34:07.614787 15888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "d5a59bfd5d004b008443bda693c91543"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "d954ddfea77a294ddc3a47cc4e038008"
server_key_iv: "ba8cc15f9d543a0b36eef8f9b228a505"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.614869 15888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:07.640739 15888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:07.642639 15888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:07.642803 15888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:07.643061 15888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:07.643368 15888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:07.643425 15888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.643467 15888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:07.643499 15888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.649215 15888 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:43651
I20260929 06:34:07.649284 16016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:43651 every 8 connection(s)
I20260929 06:34:07.649590 15888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:34:07.651350 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 15888
I20260929 06:34:07.651471 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:34:07.651691 9461 external_mini_cluster.cc:1428] Setting key f37ef7d48d500367f6106de66429aa22
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:07.663345 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.650313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:44795 (local address 127.9.61.126:36609)
0929 06:34:07.650398 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:07.650400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:07.650600 (+ 200us) server_negotiation.cc:407] Connection header received
0929 06:34:07.651075 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:07.651076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:07.651086 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:07.651144 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:07.652408 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.652995 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.654025 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.654235 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.654310 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.660679 (+ 6369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:07.660681 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:07.660681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:07.660689 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:07.661953 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.662393 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.662394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.662394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.662457 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.662708 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.662709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.662709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.662822 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:07.662899 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:07.663176 (+ 277us) server_negotiation.cc:299] Negotiation successful
0929 06:34:07.663253 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260929 06:34:07.663527 16019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.650312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.67:44795)
0929 06:34:07.650469 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:07.650509 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:07.650988 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:07.651274 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:07.651279 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:07.652124 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:07.652308 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.652313 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.653103 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.653104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.653918 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.653920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.654316 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.654318 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.654442 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.659161 (+ 4719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:07.659169 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:07.660582 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:07.662049 (+ 1467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.662055 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.662057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.662284 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.662526 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.662526 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.662527 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.662639 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.662890 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:07.662896 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:07.663041 (+ 145us) client_negotiation.cc:769] Sending connection context
0929 06:34:07.663151 (+ 110us) client_negotiation.cc:240] Negotiation successful
0929 06:34:07.663306 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":95,"threads_started":1}
I20260929 06:34:07.663975 16017 heartbeater.cc:347] Connected to a master server at 127.9.61.126:36609
I20260929 06:34:07.664093 16017 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:07.664263 16017 heartbeater.cc:511] Master 127.9.61.126:36609 requested a full tablet report, sending...
I20260929 06:34:07.664623 15558 ts_manager.cc:194] Registered new tserver with Master: d5a59bfd5d004b008443bda693c91543 (127.9.61.67:43651)
I20260929 06:34:07.665027 15558 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:44795
I20260929 06:34:07.674642 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.9.61.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.125.keytab.
Entry for principal oryx/127.9.61.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.125.keytab.
I20260929 06:34:07.698617 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.125:42211
--webserver_interface=127.9.61.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.125.keytab
--principal=oryx/127.9.61.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:36609,127.9.61.125:42211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:07.778339 16022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:07.778546 16022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:07.778574 16022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:07.779590 16022 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:07.779621 16022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:07.779635 16022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:07.779647 16022 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:07.779659 16022 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:07.781068 16022 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:36609,127.9.61.125:42211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.125.keytab
--principal=oryx/127.9.61.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.125:42211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.61.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
W20260929 06:34:07.781167 16022 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.9.61.126:36609,127.9.61.125:42211'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260929 06:34:07.781271 16022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:07.781427 16022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:07.786145 16027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:07.786144 16030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:07.786222 16028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:07.786544 16022 server_base.cc:1034] running on GCE node
I20260929 06:34:07.786768 16022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:07.786993 16022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:07.788152 16022 hybrid_clock.cc:648] HybridClock initialized: now 1790663647788137 us; error 28 us; skew 500 ppm
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:07.790580 16022 init.cc:377] Logged in from keytab as oryx/127.9.61.125@KRBTEST.COM (short username oryx)
I20260929 06:34:07.791190 16022 webserver.cc:460] Webserver started at http://127.9.61.125:41081/ using document root <none> and password file <none>
I20260929 06:34:07.791486 16022 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:07.791560 16022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:07.791700 16022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:07.793167 16022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data/instance:
uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "ed2473230ece04835580eb606b9e8bd0"
server_key_iv: "62af2f946661d4b239cab8f983d54888"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.793644 16022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/wal/instance:
uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "ed2473230ece04835580eb606b9e8bd0"
server_key_iv: "62af2f946661d4b239cab8f983d54888"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.795288 16022 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:34:07.796015 16037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.796211 16022 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:07.796300 16022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/wal
uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "ed2473230ece04835580eb606b9e8bd0"
server_key_iv: "62af2f946661d4b239cab8f983d54888"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.796387 16022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:07.829559 16022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:07.831645 16022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:07.831841 16022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:07.835700 16022 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.125:42211
I20260929 06:34:07.835767 16089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.125:42211 every 8 connection(s)
I20260929 06:34:07.836283 16022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
I20260929 06:34:07.837283 16090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:07.838878 16090 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:34:07.843427 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 16022
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.125@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:07.848170 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.839603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33076 (local address 127.9.61.126:36609)
0929 06:34:07.839668 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:07.839670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:07.839888 (+ 218us) server_negotiation.cc:407] Connection header received
0929 06:34:07.840532 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:07.840534 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:07.840545 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:07.840605 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:07.841272 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.841765 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.842705 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.842885 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.842958 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.845206 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:07.845207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:07.845207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:07.845215 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:07.846591 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.847048 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.847049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.847050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.847115 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.847346 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.847347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.847347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.847542 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:07.847611 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:07.847929 (+ 318us) server_negotiation.cc:299] Negotiation successful
0929 06:34:07.848053 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:34:07.848320 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.839566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33076)
0929 06:34:07.839757 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:07.839798 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:07.840411 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:07.840737 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:07.840741 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:07.840981 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:07.841185 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.841189 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.841841 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.841842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.842626 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.842628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.842964 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.842964 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.843069 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.843544 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:07.843564 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:07.845126 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:07.846669 (+ 1543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.846674 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.846676 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.846957 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.847185 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.847186 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.847186 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.847283 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.847611 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:07.847616 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:07.847770 (+ 154us) client_negotiation.cc:769] Sending connection context
0929 06:34:07.847889 (+ 119us) client_negotiation.cc:240] Negotiation successful
0929 06:34:07.848085 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":112,"threads_started":1}
I20260929 06:34:07.848928 16090 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.61.125@KRBTEST.COM
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.125@KRBTEST.COM for oryx/127.9.61.125@KRBTEST.COM
I20260929 06:34:07.854272 16094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.843983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33706 (local address 127.9.61.125:42211)
0929 06:34:07.844135 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:07.844142 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:07.844197 (+ 55us) server_negotiation.cc:407] Connection header received
0929 06:34:07.844271 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:07.844273 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:07.844298 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:07.844382 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:07.845072 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.846152 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.847048 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.847509 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.847584 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.850531 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:07.850544 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:07.850545 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:07.850551 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:07.852403 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.853412 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.853415 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.853416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.853486 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.853707 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.853708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.853708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.853846 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:07.854029 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:07.854084 (+ 55us) server_negotiation.cc:299] Negotiation successful
0929 06:34:07.854158 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
I20260929 06:34:07.856998 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.849192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:42211 (local address 127.0.0.1:33710)
0929 06:34:07.849238 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:07.849246 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:07.849277 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:07.849556 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:07.849557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:07.849659 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:07.849701 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.849702 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.850496 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.850497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.851140 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.851142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.851653 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.851654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.851707 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.852118 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:07.852123 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:07.853558 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:07.855983 (+ 2425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.855984 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.855985 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.856144 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.856366 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.856366 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.856367 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.856433 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.856666 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:07.856667 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:07.856702 (+ 35us) client_negotiation.cc:769] Sending connection context
0929 06:34:07.856781 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:34:07.856872 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 06:34:07.857164 16095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.849234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33710 (local address 127.9.61.125:42211)
0929 06:34:07.849404 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:07.849405 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:07.849429 (+ 24us) server_negotiation.cc:407] Connection header received
0929 06:34:07.849448 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:07.849449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:07.849458 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:07.849535 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:07.849782 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.850408 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.851224 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.851573 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.851647 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.853649 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:07.853650 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:07.853650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:07.853656 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:07.855859 (+ 2203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.856231 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.856232 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.856233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.856285 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.856495 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.856496 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.856497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.856601 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:07.856674 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:07.856803 (+ 129us) server_negotiation.cc:299] Negotiation successful
0929 06:34:07.856921 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":155,"thread_start_us":99,"threads_started":1}
I20260929 06:34:07.858364 16090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: Bootstrap starting.
I20260929 06:34:07.858927 16090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:07.859136 16090 log.cc:824] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:07.859783 16090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: No bootstrap required, opened a new log
I20260929 06:34:07.861173 16090 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } }
I20260929 06:34:07.861290 16090 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:07.861312 16090 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ebbf2d7fedb4aa6abc9e2ec7227cd3d, State: Initialized, Role: FOLLOWER
I20260929 06:34:07.861430 16090 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } }
I20260929 06:34:07.861677 16097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } } }
I20260929 06:34:07.861742 16090 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:07.861766 16097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: This master's current role is: FOLLOWER
W20260929 06:34:07.863385 16108 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:34:07.863443 16108 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:34:07.864868 16022 master_runner.cc:428] Detected that this master 2ebbf2d7fedb4aa6abc9e2ec7227cd3d is joining an existing cluster
I20260929 06:34:07.864917 16022 master_runner.cc:432] Initiating AddMaster RPC to add 127.9.61.125:42211
I20260929 06:34:07.873003 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.866050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33090 (local address 127.9.61.126:36609)
0929 06:34:07.866098 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:07.866100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:07.866229 (+ 129us) server_negotiation.cc:407] Connection header received
0929 06:34:07.866317 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:07.866318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:07.866330 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:07.866383 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:07.866894 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.867470 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.868292 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.868504 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.868587 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.869896 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:07.869897 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:07.869897 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:07.869910 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:07.871579 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.872142 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.872143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.872144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.872201 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.872427 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.872428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.872428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.872570 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:07.872643 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:07.872817 (+ 174us) server_negotiation.cc:299] Negotiation successful
0929 06:34:07.872910 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:34:07.873350 16095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.866064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33720 (local address 127.9.61.125:42211)
0929 06:34:07.866098 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:07.866100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:07.866303 (+ 203us) server_negotiation.cc:407] Connection header received
0929 06:34:07.866375 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:07.866376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:07.866385 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:07.866432 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:07.867120 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.867848 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.868881 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.869254 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.869309 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.870370 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:07.870371 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:07.870371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:07.870377 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:07.872187 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.872561 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.872562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.872562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.872610 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.872806 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.872807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.872807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.872926 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:07.872965 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:07.873134 (+ 169us) server_negotiation.cc:299] Negotiation successful
0929 06:34:07.873214 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:34:07.873212 16114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.865999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33090)
0929 06:34:07.866165 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:07.866176 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:07.866255 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:07.866429 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:07.866429 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:07.866733 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:07.866810 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.866812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.867558 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.867559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.868210 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.868212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.868589 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.868590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.868658 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.869393 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:07.869396 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:07.869808 (+ 412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:07.871678 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.871679 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.871679 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.872060 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.872294 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.872295 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.872295 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.872351 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.872631 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:07.872632 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:07.872689 (+ 57us) client_negotiation.cc:769] Sending connection context
0929 06:34:07.872778 (+ 89us) client_negotiation.cc:240] Negotiation successful
0929 06:34:07.872877 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":91,"threads_started":1}
I20260929 06:34:07.873456 16115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.866127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:42211 (local address 127.0.0.1:33720)
0929 06:34:07.866245 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:07.866255 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:07.866323 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:07.866433 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:07.866433 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:07.866991 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:07.867049 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.867051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.867937 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.867937 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.868798 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.868802 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.869329 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.869331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.869407 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.869851 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:07.869856 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:07.870283 (+ 427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:07.872267 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.872267 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.872268 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.872472 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.872684 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.872684 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.872684 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.872743 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.873005 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:07.873005 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:07.873035 (+ 30us) client_negotiation.cc:769] Sending connection context
0929 06:34:07.873227 (+ 192us) client_negotiation.cc:240] Negotiation successful
0929 06:34:07.873298 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":83,"threads_started":1}
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.126@KRBTEST.COM for oryx/127.9.61.125@KRBTEST.COM
I20260929 06:34:07.882647 16116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.875642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:42211 (local address 127.0.0.1:33736)
0929 06:34:07.875779 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:07.875818 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:07.875890 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:07.876052 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:07.876056 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:07.876306 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:07.876352 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.876353 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.877216 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.877217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.877792 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.877794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.878251 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.878252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.878305 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.878726 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:07.878730 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:07.880086 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:07.881675 (+ 1589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.881681 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.881683 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.881871 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.882069 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.882069 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.882070 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.882124 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.882368 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:07.882373 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:07.882415 (+ 42us) client_negotiation.cc:769] Sending connection context
0929 06:34:07.882490 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 06:34:07.882576 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":77,"threads_started":1}
I20260929 06:34:07.882701 16095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.875690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33736 (local address 127.9.61.125:42211)
0929 06:34:07.875729 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:07.875730 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:07.875892 (+ 162us) server_negotiation.cc:407] Connection header received
0929 06:34:07.875964 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:07.875965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:07.875975 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:07.876052 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:07.876425 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.877132 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.877872 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.878171 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.878246 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.880163 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:07.880164 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:07.880165 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:07.880171 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:07.881595 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.881943 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.881944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.881944 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.882002 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.882185 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.882185 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.882186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.882306 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:07.882370 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:07.882534 (+ 164us) server_negotiation.cc:299] Negotiation successful
0929 06:34:07.882606 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:34:07.883337 15558 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.9.61.125:42211: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d"
member_type: NON_VOTER
last_known_addr {
host: "127.9.61.125"
port: 42211
}
attrs {
promote: true
}
}
dest_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20"
cas_config_opid_index: -1
I20260929 06:34:07.883661 15558 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } }
I20260929 06:34:07.884240 16118 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 2ebbf2d7fedb4aa6abc9e2ec7227cd3d (127.9.61.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } }
I20260929 06:34:07.884539 16064 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:07.885087 16118 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.9.61.125:42211
I20260929 06:34:07.885169 16118 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } }
I20260929 06:34:07.885234 16118 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:07.885306 16022 master.cc:537] Master@127.9.61.125:42211 shutting down...
I20260929 06:34:07.885434 16064 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 FOLLOWER]: Refusing update from remote peer f7f3c408f0a443a8ad3a77e3f4cf2e20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260929 06:34:07.885891 16117 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 06:34:07.886623 15543 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260929 06:34:07.887042 15543 consensus_peers.cc:487] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 -> Peer 2ebbf2d7fedb4aa6abc9e2ec7227cd3d (127.9.61.125:42211): Couldn't send request to peer 2ebbf2d7fedb4aa6abc9e2ec7227cd3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260929 06:34:07.888078 16022 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:07.888165 16022 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:07.888214 16022 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: stopping tablet replica
I20260929 06:34:07.900799 16022 master.cc:552] Master@127.9.61.125:42211 shutdown complete.
I20260929 06:34:07.900870 16022 master_runner.cc:305] Clearing existing system tablet
I20260929 06:34:07.901001 16022 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:07.901063 16022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:07.901750 16022 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:34:07.902256 16122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.902412 16022 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:07.902472 16022 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.902494 16022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/wal
uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "ed2473230ece04835580eb606b9e8bd0"
server_key_iv: "62af2f946661d4b239cab8f983d54888"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.903136 16022 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:07.904523 16022 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260929 06:34:07.904578 16022 log.cc:1196] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260929 06:34:07.904791 16022 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: Deleting consensus metadata
I20260929 06:34:07.904933 16022 master_runner.cc:315] Copying system tablet from 127.9.61.126:36609
I20260929 06:34:07.905556 16022 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.61.126:36609
I20260929 06:34:07.912119 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.905904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33106 (local address 127.9.61.126:36609)
0929 06:34:07.905951 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:07.905953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:07.906010 (+ 57us) server_negotiation.cc:407] Connection header received
0929 06:34:07.906103 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:07.906104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:07.906115 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:07.906184 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:07.906452 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.907232 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.908077 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.908383 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.908458 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.909397 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:07.909398 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:07.909398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:07.909405 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:07.910905 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.911231 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.911232 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.911233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.911293 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.911542 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.911543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.911543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.911689 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:07.911761 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:07.911910 (+ 149us) server_negotiation.cc:299] Negotiation successful
0929 06:34:07.912004 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:34:07.912153 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.905839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33106)
0929 06:34:07.905952 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:07.905963 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:07.906023 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:07.906185 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:07.906185 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:07.906332 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:07.906384 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.906386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.907319 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.907320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.907994 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:07.907997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.908461 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.908462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:07.908523 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.909009 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:07.909014 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:07.909312 (+ 298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:07.910994 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.910995 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.910995 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.911161 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.911390 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:07.911391 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:07.911391 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:07.911464 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:07.911762 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:07.911763 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:07.911805 (+ 42us) client_negotiation.cc:769] Sending connection context
0929 06:34:07.911866 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 06:34:07.912069 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":73,"threads_started":1}
I20260929 06:34:07.912542 15578 tablet_copy_service.cc:140] P f7f3c408f0a443a8ad3a77e3f4cf2e20: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2ebbf2d7fedb4aa6abc9e2ec7227cd3d ({username='oryx', principal='oryx/127.9.61.125@KRBTEST.COM'} at 127.0.0.1:33106)
I20260929 06:34:07.912653 15578 tablet_copy_service.cc:161] P f7f3c408f0a443a8ad3a77e3f4cf2e20: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2ebbf2d7fedb4aa6abc9e2ec7227cd3d at {username='oryx', principal='oryx/127.9.61.125@KRBTEST.COM'} at 127.0.0.1:33106: session id = 2ebbf2d7fedb4aa6abc9e2ec7227cd3d-00000000000000000000000000000000
I20260929 06:34:07.913535 15578 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 06:34:07.914175 16022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260929 06:34:07.915112 16022 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: tablet copy: Starting download of 0 data blocks...
I20260929 06:34:07.915267 16022 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: tablet copy: Starting download of 1 WAL segments...
I20260929 06:34:07.916209 16022 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 06:34:07.917150 15578 tablet_copy_service.cc:342] P f7f3c408f0a443a8ad3a77e3f4cf2e20: Request end of tablet copy session 2ebbf2d7fedb4aa6abc9e2ec7227cd3d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.9.61.125@KRBTEST.COM'} at 127.0.0.1:33106
I20260929 06:34:07.917217 15578 tablet_copy_service.cc:433] P f7f3c408f0a443a8ad3a77e3f4cf2e20: ending tablet copy session 2ebbf2d7fedb4aa6abc9e2ec7227cd3d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2ebbf2d7fedb4aa6abc9e2ec7227cd3d
I20260929 06:34:07.919538 16022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:07.920634 16129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:07.920668 16130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:07.921015 16022 server_base.cc:1034] running on GCE node
W20260929 06:34:07.921065 16132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:07.921212 16022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:07.921368 16022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:07.922501 16022 hybrid_clock.cc:648] HybridClock initialized: now 1790663647922491 us; error 26 us; skew 500 ppm
Sep 29 06:34:07 dist-test-slave-601b krb5kdc[15513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:07.923852 16022 init.cc:377] Logged in from keytab as oryx/127.9.61.125@KRBTEST.COM (short username oryx)
I20260929 06:34:07.924196 16022 webserver.cc:460] Webserver started at http://127.9.61.125:37699/ using document root <none> and password file <none>
I20260929 06:34:07.924335 16022 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:07.924374 16022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:07.924989 16022 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:34:07.925561 16139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:07.925681 16022 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:34:07.925729 16022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/wal
uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "ed2473230ece04835580eb606b9e8bd0"
server_key_iv: "62af2f946661d4b239cab8f983d54888"
server_key_version: "encryptionkey@0"
I20260929 06:34:07.925784 16022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:07.929976 16022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:07.931510 16022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:07.934584 16022 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.125:42211
I20260929 06:34:07.934926 16191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.125:42211 every 8 connection(s)
I20260929 06:34:07.935050 16022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
I20260929 06:34:07.935863 16192 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:34:07.936440 16192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: Bootstrap starting.
I20260929 06:34:07.939255 16192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:34:07.939486 16192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: Bootstrap complete.
I20260929 06:34:07.939664 16192 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } }
I20260929 06:34:07.939754 16192 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2ebbf2d7fedb4aa6abc9e2ec7227cd3d, State: Initialized, Role: LEARNER
I20260929 06:34:07.939807 16192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } }
I20260929 06:34:07.940011 16192 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:07.940001 16195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } }
I20260929 06:34:07.940112 16195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: This master's current role is: LEARNER
I20260929 06:34:07.941526 16206 catalog_manager.cc:1259] Loaded cluster ID: b1f9418de52a4e44a14261bfd7785b5f
I20260929 06:34:07.941576 16206 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: loading cluster ID for follower catalog manager: success
I20260929 06:34:07.942553 16206 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: acquiring CA information for follower catalog manager: success
I20260929 06:34:07.942827 16206 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:34:07.963541 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:07.956064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33762 (local address 127.9.61.125:42211)
0929 06:34:07.956213 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:07.956215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:07.956227 (+ 12us) server_negotiation.cc:407] Connection header received
0929 06:34:07.956253 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:07.956254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:07.956263 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:07.956328 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:07.957027 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.957746 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.958818 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:07.959051 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:07.959112 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:07.960624 (+ 1512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:07.960625 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:07.960625 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:07.960632 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:07.962279 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.962690 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.962691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.962692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.962752 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:07.962987 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:07.962988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:07.962988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:07.963103 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:07.963205 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:07.963329 (+ 124us) server_negotiation.cc:299] Negotiation successful
0929 06:34:07.963396 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
WARNING: no policy specified for oryx/127.9.61.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.124.keytab.
Entry for principal oryx/127.9.61.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.124.keytab.
I20260929 06:34:07.988761 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.124:39313
--webserver_interface=127.9.61.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.124.keytab
--principal=oryx/127.9.61.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:36609,127.9.61.125:42211,127.9.61.124:39313
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:08.072821 16210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:08.073030 16210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:08.073058 16210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:08.074153 16210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:08.074188 16210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:08.074203 16210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:08.074214 16210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:08.074226 16210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:08.075644 16210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:36609,127.9.61.125:42211,127.9.61.124:39313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.124.keytab
--principal=oryx/127.9.61.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.124:39313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.61.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:08.075825 16210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:08.076047 16210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:08.080681 16216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:08.080650 16215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:08.080650 16218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:08.080801 16210 server_base.cc:1034] running on GCE node
I20260929 06:34:08.081157 16210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:08.081418 16210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:08.082593 16210 hybrid_clock.cc:648] HybridClock initialized: now 1790663648082576 us; error 33 us; skew 500 ppm
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:08.085170 16210 init.cc:377] Logged in from keytab as oryx/127.9.61.124@KRBTEST.COM (short username oryx)
I20260929 06:34:08.085520 16210 webserver.cc:460] Webserver started at http://127.9.61.124:36247/ using document root <none> and password file <none>
I20260929 06:34:08.085701 16210 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:08.085744 16210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:08.085836 16210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:08.086790 16210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data/instance:
uuid: "640ba75a0d5147af9b6a7d81577120f4"
format_stamp: "Formatted at 2026-09-29 06:34:08 on dist-test-slave-601b"
server_key: "5b0b664fab1b5faa61092e3453385136"
server_key_iv: "d79e3990f1635fa81310ddd905709487"
server_key_version: "encryptionkey@0"
I20260929 06:34:08.087087 16210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/wal/instance:
uuid: "640ba75a0d5147af9b6a7d81577120f4"
format_stamp: "Formatted at 2026-09-29 06:34:08 on dist-test-slave-601b"
server_key: "5b0b664fab1b5faa61092e3453385136"
server_key_iv: "d79e3990f1635fa81310ddd905709487"
server_key_version: "encryptionkey@0"
I20260929 06:34:08.088420 16210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:34:08.089076 16225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.089257 16210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:08.089344 16210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/wal
uuid: "640ba75a0d5147af9b6a7d81577120f4"
format_stamp: "Formatted at 2026-09-29 06:34:08 on dist-test-slave-601b"
server_key: "5b0b664fab1b5faa61092e3453385136"
server_key_iv: "d79e3990f1635fa81310ddd905709487"
server_key_version: "encryptionkey@0"
I20260929 06:34:08.089408 16210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:08.109086 16210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:08.110894 16210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:08.111040 16210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:08.115305 16210 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.124:39313
I20260929 06:34:08.115474 16277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.124:39313 every 8 connection(s)
I20260929 06:34:08.115787 16210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
I20260929 06:34:08.116663 16278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:08.118255 16278 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:34:08.123596 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 16210
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.124@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:08.127413 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.119138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33116 (local address 127.9.61.126:36609)
0929 06:34:08.119213 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.119215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.119290 (+ 75us) server_negotiation.cc:407] Connection header received
0929 06:34:08.119713 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.119714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.119724 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.119778 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.120469 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.120941 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.121877 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.122067 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.122118 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.124467 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.124469 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.124469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.124476 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.125971 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.126371 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.126372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.126373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.126432 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.126726 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.126727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.126727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.126876 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.126965 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.127240 (+ 275us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.127326 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260929 06:34:08.127565 16280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.118953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33116)
0929 06:34:08.119163 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.119204 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.119634 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.119851 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.119854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.120213 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.120395 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.120399 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.121053 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.121054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.121806 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.121808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.122136 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.122136 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.122230 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.122649 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.122657 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.124373 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.126060 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.126066 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.126069 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.126280 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.126499 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.126500 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.126500 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.126611 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.126956 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.126963 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.127100 (+ 137us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.127208 (+ 108us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.127345 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":95,"threads_started":1}
I20260929 06:34:08.128158 16278 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.61.124@KRBTEST.COM
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.124@KRBTEST.COM for oryx/127.9.61.125@KRBTEST.COM
I20260929 06:34:08.132804 16281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.124087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50266 (local address 127.9.61.124:39313)
0929 06:34:08.124247 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.124252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.124273 (+ 21us) server_negotiation.cc:407] Connection header received
0929 06:34:08.124299 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.124301 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.124316 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.124392 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.125082 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.125947 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.126753 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.127087 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.127182 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.129721 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.129728 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.129728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.129735 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.131591 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.131932 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.131935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.131935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.132020 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.132219 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.132220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.132220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.132352 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.132500 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.132608 (+ 108us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.132680 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":76,"threads_started":1}
I20260929 06:34:08.134953 16280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.128395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:42211 (local address 127.0.0.1:33774)
0929 06:34:08.128441 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.128451 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.128485 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.128666 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.128667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.128797 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.128836 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.128837 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.129568 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.129569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.130356 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.130359 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.130856 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.130857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.130932 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.131231 (+ 299us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.131236 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.132591 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.134167 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.134168 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.134168 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.134322 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.134509 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.134510 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.134510 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.134565 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.134758 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.134759 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.134789 (+ 30us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.134837 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.134898 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 06:34:08.134979 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.128481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33774 (local address 127.9.61.125:42211)
0929 06:34:08.128547 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.128549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.128557 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:34:08.128583 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.128583 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.128596 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.128665 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.128922 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.129451 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.130465 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.130779 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.130834 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.132681 (+ 1847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.132683 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.132683 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.132690 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.134098 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.134388 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.134389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.134389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.134446 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.134616 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.134616 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.134616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.134709 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.134756 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.134853 (+ 97us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.134916 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260929 06:34:08.135438 16278 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.124@KRBTEST.COM for oryx/127.9.61.124@KRBTEST.COM
I20260929 06:34:08.141594 16280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.135660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:39313 (local address 127.0.0.1:50282)
0929 06:34:08.135707 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.135717 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.135755 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.135873 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.135874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.136054 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.136076 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.136078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.136745 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.136746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.137194 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.137195 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.137563 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.137564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.137610 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.137982 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.137986 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.138999 (+ 1013us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.140601 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.140601 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.140602 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.140756 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.140978 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.140978 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.140979 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.141031 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.141270 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.141271 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.141305 (+ 34us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.141371 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.141457 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260929 06:34:08.141757 16281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.135714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50282 (local address 127.9.61.124:39313)
0929 06:34:08.135744 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.135747 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.135754 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:34:08.135810 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.135810 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.135819 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.135870 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.136147 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.136655 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.137285 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.137476 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.137564 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.139146 (+ 1582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.139147 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.139147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.139153 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.140514 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.140837 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.140838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.140838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.140889 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.141107 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.141107 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.141108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.141206 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.141278 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.141398 (+ 120us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.141557 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":78,"server-negotiator.queue_time_us":16}
I20260929 06:34:08.142867 16278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: Bootstrap starting.
I20260929 06:34:08.143635 16278 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:08.143858 16278 log.cc:824] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:08.144546 16278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: No bootstrap required, opened a new log
I20260929 06:34:08.145870 16278 raft_consensus.cc:348] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } }
I20260929 06:34:08.145980 16278 raft_consensus.cc:374] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:08.146001 16278 raft_consensus.cc:729] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 640ba75a0d5147af9b6a7d81577120f4, State: Initialized, Role: FOLLOWER
I20260929 06:34:08.146124 16278 consensus_queue.cc:260] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } }
I20260929 06:34:08.146376 16278 sys_catalog.cc:564] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:08.146369 16283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } } }
I20260929 06:34:08.146482 16283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: This master's current role is: FOLLOWER
W20260929 06:34:08.148046 16294 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:34:08.148106 16294 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:34:08.150291 16210 master_runner.cc:428] Detected that this master 640ba75a0d5147af9b6a7d81577120f4 is joining an existing cluster
I20260929 06:34:08.150341 16210 master_runner.cc:432] Initiating AddMaster RPC to add 127.9.61.124:39313
I20260929 06:34:08.181003 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.151443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33784 (local address 127.9.61.125:42211)
0929 06:34:08.151509 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.151511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.151777 (+ 266us) server_negotiation.cc:407] Connection header received
0929 06:34:08.151848 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.151849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.151858 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.151899 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.152245 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.152739 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.153529 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.153738 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.153809 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.154790 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.154792 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.154792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.154799 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.156435 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.160088 (+ 3653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.160089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.160089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.160154 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.180271 (+ 20117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.180273 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.180274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.180478 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.180566 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.180784 (+ 218us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.180889 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 06:34:08.181634 16281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.151343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50288 (local address 127.9.61.124:39313)
0929 06:34:08.151387 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.151389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.156171 (+ 4782us) server_negotiation.cc:407] Connection header received
0929 06:34:08.156241 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.156242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.156268 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.156328 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.156778 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.157421 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.158398 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.158686 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.158722 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.159813 (+ 1091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.159814 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.159815 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.159821 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.161211 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.180848 (+ 19637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.180849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.180849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.180898 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.181093 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.181094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.181095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.181206 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.181240 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.181409 (+ 169us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.181486 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:34:08.181494 16302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.151299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:42211 (local address 127.0.0.1:33784)
0929 06:34:08.151705 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.151715 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.151789 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.151911 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.151912 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.152114 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.152166 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.152168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.152836 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.152837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.153431 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.153433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.153830 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.153832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.153897 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.154361 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.154367 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.154681 (+ 314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.156527 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.156527 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.156528 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.159172 (+ 2644us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.160525 (+ 1353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.160526 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.160527 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.180144 (+ 19617us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.180603 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.180604 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.180659 (+ 55us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.181224 (+ 565us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.181354 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":78,"threads_started":1}
I20260929 06:34:08.182044 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.151417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:39313 (local address 127.0.0.1:50288)
0929 06:34:08.156098 (+ 4681us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.156111 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.156186 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.156377 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.156378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.156641 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.156703 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.156704 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.157520 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.157520 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.158307 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.158310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.158781 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.158781 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.158845 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.159276 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.159281 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.159725 (+ 444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.161314 (+ 1589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.161315 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.161315 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.180754 (+ 19439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.180976 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.180976 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.180976 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.181028 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.181275 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.181275 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.181310 (+ 35us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.181540 (+ 230us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.181924 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4651,"thread_start_us":70,"threads_started":1}
I20260929 06:34:08.184109 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 15620
I20260929 06:34:08.185245 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.151650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33132 (local address 127.9.61.126:36609)
0929 06:34:08.151695 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.151697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.156341 (+ 4644us) server_negotiation.cc:407] Connection header received
0929 06:34:08.156698 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.156699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.156711 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.156744 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.157493 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.158314 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.159510 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.159816 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.159883 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.181393 (+ 21510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.181395 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.181395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.181403 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.183438 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.183827 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.183829 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.183829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.183892 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.184247 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.184618 (+ 371us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.184619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.184774 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.184844 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.185046 (+ 202us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.185141 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:34:08.185269 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.151597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33132)
0929 06:34:08.156283 (+ 4686us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.156292 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.156602 (+ 310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.156809 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.156810 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.156991 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.157366 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.157369 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.158434 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.158435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.159417 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.159420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.159900 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.159901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.159999 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.180535 (+ 20536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.180541 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.181018 (+ 477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.183546 (+ 2528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.183547 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.183547 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.183769 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.184027 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.184028 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.184028 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.184105 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.184873 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.184874 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.184916 (+ 42us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.184988 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.185104 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4673,"thread_start_us":64,"threads_started":1}
I20260929 06:34:08.190920 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:43577
--local_ip_for_outbound_sockets=127.9.61.65
--tserver_master_addrs=127.9.61.126:36609
--webserver_port=46627
--webserver_interface=127.9.61.65
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab
--principal=oryx/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.61.126:36609,127.9.61.125:42211
--tserver_master_addrs=127.9.61.126:36609,127.9.61.125:42211,127.9.61.124:39313 with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663647, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.126@KRBTEST.COM for oryx/127.9.61.124@KRBTEST.COM
I20260929 06:34:08.198014 16281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.187785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50294 (local address 127.9.61.124:39313)
0929 06:34:08.187828 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.187830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.189744 (+ 1914us) server_negotiation.cc:407] Connection header received
0929 06:34:08.189785 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.189786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.189797 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.189862 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.190193 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.191012 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.192181 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.192518 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.192589 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.194843 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.194845 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.194845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.194853 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.196684 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.197113 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.197114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.197114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.197182 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.197426 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.197427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.197427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.197569 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.197648 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.197833 (+ 185us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.197914 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:34:08.198028 16116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.187732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:39313 (local address 127.0.0.1:50294)
0929 06:34:08.189680 (+ 1948us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.189690 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.189733 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.189883 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.189884 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.190062 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.190113 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.190115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.191116 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.191117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.192080 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.192083 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.192601 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.192603 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.192685 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.193141 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.193147 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.194746 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.196781 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.196782 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.196783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.197020 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.197265 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.197266 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.197266 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.197340 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.197652 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.197653 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.197706 (+ 53us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.197789 (+ 83us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.197905 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1930}
I20260929 06:34:08.198931 15558 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.9.61.124:39313: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4"
member_type: NON_VOTER
last_known_addr {
host: "127.9.61.124"
port: 39313
}
attrs {
promote: true
}
}
dest_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20"
cas_config_opid_index: 5
I20260929 06:34:08.199218 15558 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } }
I20260929 06:34:08.199668 16118 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 640ba75a0d5147af9b6a7d81577120f4 (127.9.61.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } } }
I20260929 06:34:08.199869 16252 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:08.201042 16118 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.9.61.124:39313
I20260929 06:34:08.201123 16118 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } } }
I20260929 06:34:08.201202 16118 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:08.201381 16252 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 FOLLOWER]: Refusing update from remote peer f7f3c408f0a443a8ad3a77e3f4cf2e20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260929 06:34:08.201733 16117 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:08.203135 16252 raft_consensus.cc:858] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } }
W20260929 06:34:08.203200 16252 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } }
I20260929 06:34:08.203713 16252 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 2ebbf2d7fedb4aa6abc9e2ec7227cd3d (127.9.61.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } }
I20260929 06:34:08.204937 16283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7f3c408f0a443a8ad3a77e3f4cf2e20. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } }
I20260929 06:34:08.205009 16283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260929 06:34:08.205042 16283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } }
I20260929 06:34:08.205080 16283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260929 06:34:08.205108 16283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } }
I20260929 06:34:08.205144 16283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260929 06:34:08.205328 16116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.200090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:42211 (local address 127.0.0.1:33788)
0929 06:34:08.201445 (+ 1355us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.201468 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.201513 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.202047 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.202048 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.202050 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:08.202092 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.202094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.202987 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.202988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.204238 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.204241 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.205081 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.205082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.205148 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.205168 (+ 20us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.205218 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.205254 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1340}
I20260929 06:34:08.205559 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.200195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33788 (local address 127.9.61.125:42211)
0929 06:34:08.201415 (+ 1220us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.201417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.201567 (+ 150us) server_negotiation.cc:407] Connection header received
0929 06:34:08.201594 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.201595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.201620 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.201682 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:08.202186 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.202879 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.204329 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.204917 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.204984 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.205048 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.205460 (+ 412us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.205496 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1192}
I20260929 06:34:08.205724 16166 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 LEARNER]: Refusing update from remote peer f7f3c408f0a443a8ad3a77e3f4cf2e20: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260929 06:34:08.205892 16117 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260929 06:34:08.206363 16166 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 640ba75a0d5147af9b6a7d81577120f4 (127.9.61.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } } }
I20260929 06:34:08.206673 16117 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } } }
I20260929 06:34:08.206761 16117 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:08.207048 16252 raft_consensus.cc:1467] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 NON_PARTICIPANT]: Allowing update even though not a member of the config
I20260929 06:34:08.207137 16252 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 640ba75a0d5147af9b6a7d81577120f4 (127.9.61.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } } }
I20260929 06:34:08.207585 16195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7f3c408f0a443a8ad3a77e3f4cf2e20. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } } }
I20260929 06:34:08.207659 16195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: This master's current role is: LEARNER
I20260929 06:34:08.207691 16195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } } }
I20260929 06:34:08.207727 16195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: This master's current role is: LEARNER
I20260929 06:34:08.207898 16210 master.cc:537] Master@127.9.61.124:39313 shutting down...
I20260929 06:34:08.208067 16306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } } }
I20260929 06:34:08.208233 16306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: This master's current role is: LEARNER
I20260929 06:34:08.208679 16118 raft_consensus.cc:1050] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20: attempting to promote NON_VOTER 640ba75a0d5147af9b6a7d81577120f4 to VOTER
I20260929 06:34:08.208771 16304 mvcc.cc:205] Tried to move back new op lower bound from 7334558298873307136 to 7334558298791202816. Current Snapshot: MvccSnapshot[applied={T|T < 7334558298800619520}]
I20260929 06:34:08.208884 16118 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } }
W20260929 06:34:08.209717 15544 consensus_peers.cc:487] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 -> Peer 640ba75a0d5147af9b6a7d81577120f4 (127.9.61.124:39313): Couldn't send request to peer 640ba75a0d5147af9b6a7d81577120f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260929 06:34:08.211133 16210 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 LEARNER]: Raft consensus shutting down.
I20260929 06:34:08.211244 16210 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 LEARNER]: Raft consensus is shut down!
I20260929 06:34:08.211292 16210 tablet_replica.cc:330] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: stopping tablet replica
I20260929 06:34:08.211386 16165 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 LEARNER]: Refusing update from remote peer f7f3c408f0a443a8ad3a77e3f4cf2e20: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260929 06:34:08.211824 16313 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260929 06:34:08.212515 16117 raft_consensus.cc:1013] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 1 LEADER]: attempt to promote peer 2ebbf2d7fedb4aa6abc9e2ec7227cd3d: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260929 06:34:08.230010 16210 master.cc:552] Master@127.9.61.124:39313 shutdown complete.
I20260929 06:34:08.230075 16210 master_runner.cc:305] Clearing existing system tablet
I20260929 06:34:08.230206 16210 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:08.230253 16210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:08.231004 16210 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:08.231571 16315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.231683 16210 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:08.231722 16210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.231742 16210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/wal
uuid: "640ba75a0d5147af9b6a7d81577120f4"
format_stamp: "Formatted at 2026-09-29 06:34:08 on dist-test-slave-601b"
server_key: "5b0b664fab1b5faa61092e3453385136"
server_key_iv: "d79e3990f1635fa81310ddd905709487"
server_key_version: "encryptionkey@0"
I20260929 06:34:08.232453 16210 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:08.234006 16210 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260929 06:34:08.234081 16210 log.cc:1196] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260929 06:34:08.234319 16210 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: Deleting consensus metadata
I20260929 06:34:08.234448 16210 master_runner.cc:315] Copying system tablet from 127.9.61.126:36609
I20260929 06:34:08.235067 16210 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: tablet copy: Beginning tablet copy session from remote peer at address 127.9.61.126:36609
I20260929 06:34:08.243297 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.235454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33138 (local address 127.9.61.126:36609)
0929 06:34:08.235509 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.235511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.236145 (+ 634us) server_negotiation.cc:407] Connection header received
0929 06:34:08.236207 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.236208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.236221 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.236288 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.236699 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.237570 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.238626 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.238924 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.238996 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.240279 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.240280 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.240281 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.240288 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.242051 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.242459 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.242460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.242460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.242521 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.242747 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.242747 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.242748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.242874 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.242950 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.243128 (+ 178us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.243206 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260929 06:34:08.243314 16321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.235378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33138)
0929 06:34:08.236049 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.236062 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.236141 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.236308 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.236310 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.236536 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.236597 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.236599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.237675 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.237676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.238529 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.238532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.239015 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.239016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.239091 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.239658 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.239663 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.240144 (+ 481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.242152 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.242153 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.242153 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.242374 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.242597 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.242599 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.242599 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.242673 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.242955 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.242956 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.243006 (+ 50us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.243088 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.243199 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":65,"threads_started":1}
I20260929 06:34:08.243961 15578 tablet_copy_service.cc:140] P f7f3c408f0a443a8ad3a77e3f4cf2e20: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 640ba75a0d5147af9b6a7d81577120f4 ({username='oryx', principal='oryx/127.9.61.124@KRBTEST.COM'} at 127.0.0.1:33138)
I20260929 06:34:08.244019 15578 tablet_copy_service.cc:161] P f7f3c408f0a443a8ad3a77e3f4cf2e20: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 640ba75a0d5147af9b6a7d81577120f4 at {username='oryx', principal='oryx/127.9.61.124@KRBTEST.COM'} at 127.0.0.1:33138: session id = 640ba75a0d5147af9b6a7d81577120f4-00000000000000000000000000000000
I20260929 06:34:08.244567 15578 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 06:34:08.245121 16210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260929 06:34:08.246435 16210 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: tablet copy: Starting download of 0 data blocks...
I20260929 06:34:08.246588 16210 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: tablet copy: Starting download of 1 WAL segments...
I20260929 06:34:08.247375 16210 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 06:34:08.248279 15578 tablet_copy_service.cc:342] P f7f3c408f0a443a8ad3a77e3f4cf2e20: Request end of tablet copy session 640ba75a0d5147af9b6a7d81577120f4-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.9.61.124@KRBTEST.COM'} at 127.0.0.1:33138
I20260929 06:34:08.248327 15578 tablet_copy_service.cc:433] P f7f3c408f0a443a8ad3a77e3f4cf2e20: ending tablet copy session 640ba75a0d5147af9b6a7d81577120f4-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 640ba75a0d5147af9b6a7d81577120f4
I20260929 06:34:08.251045 16210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:08.252116 16322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:08.252460 16210 server_base.cc:1034] running on GCE node
W20260929 06:34:08.252629 16325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:08.256117 16323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:08.256282 16210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:08.256461 16210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:08.257611 16210 hybrid_clock.cc:648] HybridClock initialized: now 1790663648257602 us; error 24 us; skew 500 ppm
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:08.259119 16210 init.cc:377] Logged in from keytab as oryx/127.9.61.124@KRBTEST.COM (short username oryx)
I20260929 06:34:08.259392 16210 webserver.cc:460] Webserver started at http://127.9.61.124:40383/ using document root <none> and password file <none>
I20260929 06:34:08.259506 16210 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:08.259544 16210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:08.260269 16210 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:08.260840 16332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.260989 16210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:08.261044 16210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/wal
uuid: "640ba75a0d5147af9b6a7d81577120f4"
format_stamp: "Formatted at 2026-09-29 06:34:08 on dist-test-slave-601b"
server_key: "5b0b664fab1b5faa61092e3453385136"
server_key_iv: "d79e3990f1635fa81310ddd905709487"
server_key_version: "encryptionkey@0"
I20260929 06:34:08.261103 16210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260929 06:34:08.289759 16303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:08.289985 16303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:08.290024 16303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:08.291222 16303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:08.291287 16303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:08.291332 16303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:34:08.292853 16303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab
--principal=oryx/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:43577
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=46627
--tserver_master_addrs=127.9.61.126:36609,127.9.61.125:42211,127.9.61.124:39313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:08.293113 16303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:08.293349 16303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:08.298156 16344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:08.299203 16341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:08.299309 16342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:08.299531 16303 server_base.cc:1034] running on GCE node
I20260929 06:34:08.299772 16303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:08.300083 16303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:08.301241 16303 hybrid_clock.cc:648] HybridClock initialized: now 1790663648301233 us; error 29 us; skew 500 ppm
I20260929 06:34:08.301870 16210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:08.304158 16303 init.cc:377] Logged in from keytab as oryx/127.9.61.65@KRBTEST.COM (short username oryx)
I20260929 06:34:08.304656 16303 webserver.cc:460] Webserver started at http://127.9.61.65:46627/ using document root <none> and password file <none>
I20260929 06:34:08.304890 16303 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:08.304989 16303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:08.306735 16303 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:34:08.306861 16210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:08.307396 16353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.307536 16303 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:08.307623 16303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "ef697f01324e4f65854299d26cd23035"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "a9b6b001a3ac1bf550fb1343ad14895b"
server_key_iv: "cd508930d3cb74661f3dc63dcbe249d7"
server_key_version: "encryptionkey@0"
I20260929 06:34:08.308073 16303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:08.309857 16210 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.124:39313
I20260929 06:34:08.310168 16210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
I20260929 06:34:08.311182 16399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.124:39313 every 8 connection(s)
I20260929 06:34:08.311853 16400 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:34:08.312362 16400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: Bootstrap starting.
I20260929 06:34:08.314429 16400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=6 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260929 06:34:08.314631 16400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: Bootstrap complete.
I20260929 06:34:08.314790 16400 raft_consensus.cc:348] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } }
I20260929 06:34:08.314932 16400 raft_consensus.cc:729] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 640ba75a0d5147af9b6a7d81577120f4, State: Initialized, Role: FOLLOWER
I20260929 06:34:08.314973 16400 consensus_queue.cc:260] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } }
I20260929 06:34:08.315121 16400 sys_catalog.cc:564] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:08.316617 16418 catalog_manager.cc:1259] Loaded cluster ID: b1f9418de52a4e44a14261bfd7785b5f
I20260929 06:34:08.316673 16418 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: loading cluster ID for follower catalog manager: success
I20260929 06:34:08.316159 16407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.317346 16407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:34:08.317840 16418 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: acquiring CA information for follower catalog manager: success
I20260929 06:34:08.318118 16418 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:34:08.323022 16303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:08.325405 16303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:08.325558 16303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:08.325803 16303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:08.326100 16303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:08.326152 16303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.326192 16303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:08.326218 16303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.332090 16303 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:43577
I20260929 06:34:08.332137 16527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:43577 every 8 connection(s)
I20260929 06:34:08.332435 16303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:34:08.337936 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 16303
I20260929 06:34:08.338117 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 15754
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.124@KRBTEST.COM
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.125@KRBTEST.COM
I20260929 06:34:08.343999 16534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.333114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:40011 (local address 127.9.61.124:39313)
0929 06:34:08.333268 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.333270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.333411 (+ 141us) server_negotiation.cc:407] Connection header received
0929 06:34:08.333904 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.333906 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.333917 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.333956 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.334642 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.335634 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.336513 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.336805 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.336867 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.340172 (+ 3305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.340173 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.340174 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.340181 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.342291 (+ 2110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.342842 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.342843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.342843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.342919 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.343213 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.343214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.343214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.343354 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.343400 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.343769 (+ 369us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.343859 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":50,"threads_started":1}
I20260929 06:34:08.344023 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.333211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:54339 (local address 127.9.61.126:36609)
0929 06:34:08.333329 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.333331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.333340 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:08.333894 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.333895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.333907 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.333962 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.334664 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.335170 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.336565 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.336869 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.336928 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.340561 (+ 3633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.340563 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.340563 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.340570 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.342497 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.342979 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.342980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.342980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.343040 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.343233 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.343234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.343234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.343364 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.343405 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.343774 (+ 369us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.343863 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260929 06:34:08.344544 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.333259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:42431 (local address 127.9.61.125:42211)
0929 06:34:08.333361 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.333363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.333484 (+ 121us) server_negotiation.cc:407] Connection header received
0929 06:34:08.333904 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.333905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.333917 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.333950 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.334688 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.335412 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.336577 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.336786 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.336874 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.340870 (+ 3996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.340871 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.340871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.340878 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.343279 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.343651 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.343652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.343652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.343711 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.343911 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.343912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.343912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.344082 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.344139 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.344370 (+ 231us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.344440 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260929 06:34:08.344614 16532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.333035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:42211 (local address 127.9.61.65:42431)
0929 06:34:08.333431 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.333439 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.333812 (+ 373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.334402 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.334403 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.334538 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.334591 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.334593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.335492 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.335493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.336436 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.336438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.336886 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.336887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.337024 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.337662 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.337672 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.340774 (+ 3102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.343354 (+ 2580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.343355 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.343355 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.343566 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.343784 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.343785 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.343785 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.343844 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.344205 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.344205 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.344244 (+ 39us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.344334 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.344430 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":207,"thread_start_us":64,"threads_started":1}
I20260929 06:34:08.344617 16533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.333034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.65:54339)
0929 06:34:08.333190 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.333234 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.333792 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.334030 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.334033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.334317 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.334493 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.334497 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.335281 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.335282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.336436 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.336438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.336939 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.336940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.337024 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.337692 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.337696 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.340484 (+ 2788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.342592 (+ 2108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.342593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.342594 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.342864 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.343109 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.343110 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.343110 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.343169 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.343449 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.343455 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.343618 (+ 163us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.344102 (+ 484us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.344309 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":6,"thread_start_us":84,"threads_started":1}
I20260929 06:34:08.344841 16535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.333043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:39313 (local address 127.9.61.65:40011)
0929 06:34:08.333329 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.333340 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.333812 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.334031 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.334034 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.334337 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.334494 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.334501 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.335715 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.335716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.336410 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.336412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.336922 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.336923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.337026 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.337739 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.337744 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.340062 (+ 2318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.342386 (+ 2324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.342393 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.342396 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.342751 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.342997 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.342998 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.342999 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.343130 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.343448 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.343453 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.343615 (+ 162us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.344080 (+ 465us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.344691 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":422,"thread_start_us":72,"threads_started":1}
I20260929 06:34:08.345230 16528 heartbeater.cc:347] Connected to a master server at 127.9.61.124:39313
I20260929 06:34:08.345286 16530 heartbeater.cc:347] Connected to a master server at 127.9.61.125:42211
I20260929 06:34:08.345350 16530 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:08.345350 16528 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:08.345525 16528 heartbeater.cc:511] Master 127.9.61.124:39313 requested a full tablet report, sending...
I20260929 06:34:08.345528 16530 heartbeater.cc:511] Master 127.9.61.125:42211 requested a full tablet report, sending...
I20260929 06:34:08.345928 16529 heartbeater.cc:347] Connected to a master server at 127.9.61.126:36609
I20260929 06:34:08.345973 16529 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:08.346045 16529 heartbeater.cc:511] Master 127.9.61.126:36609 requested a full tablet report, sending...
I20260929 06:34:08.346100 16359 ts_manager.cc:194] Registered new tserver with Master: ef697f01324e4f65854299d26cd23035 (127.9.61.65:43577)
I20260929 06:34:08.346330 15558 ts_manager.cc:194] Re-registered known tserver with Master: ef697f01324e4f65854299d26cd23035 (127.9.61.65:43577)
I20260929 06:34:08.346381 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:40579
--local_ip_for_outbound_sockets=127.9.61.66
--tserver_master_addrs=127.9.61.126:36609
--webserver_port=41519
--webserver_interface=127.9.61.66
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab
--principal=oryx/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.61.126:36609,127.9.61.125:42211
--tserver_master_addrs=127.9.61.126:36609,127.9.61.125:42211,127.9.61.124:39313 with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:34:08.346841 15558 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:54339
I20260929 06:34:08.347239 16156 ts_manager.cc:194] Registered new tserver with Master: ef697f01324e4f65854299d26cd23035 (127.9.61.65:43577)
W20260929 06:34:08.427114 16536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:08.427295 16536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:08.427316 16536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:08.428458 16536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:08.428496 16536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:08.428522 16536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:34:08.429915 16536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab
--principal=oryx/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:40579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=41519
--tserver_master_addrs=127.9.61.126:36609,127.9.61.125:42211,127.9.61.124:39313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:08.430088 16536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:08.430248 16536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:08.434983 16541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:08.434988 16542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:08.435119 16536 server_base.cc:1034] running on GCE node
W20260929 06:34:08.434988 16544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:08.435379 16536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:08.435562 16536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:08.436703 16536 hybrid_clock.cc:648] HybridClock initialized: now 1790663648436692 us; error 27 us; skew 500 ppm
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:08.439153 16536 init.cc:377] Logged in from keytab as oryx/127.9.61.66@KRBTEST.COM (short username oryx)
I20260929 06:34:08.439721 16536 webserver.cc:460] Webserver started at http://127.9.61.66:41519/ using document root <none> and password file <none>
I20260929 06:34:08.440021 16536 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:08.440097 16536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:08.441689 16536 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:08.442308 16551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.442492 16536 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:08.442605 16536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "64a5b1fcee224070b0ef36b33985af23"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "1a695cb63fa1d627f81fc1a8d85113dc"
server_key_iv: "9a4feff7b6c12201766d5fa686ede8aa"
server_key_version: "encryptionkey@0"
I20260929 06:34:08.442938 16536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:08.459774 16536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:08.461773 16536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:08.461934 16536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:08.462160 16536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:08.462455 16536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:08.462507 16536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.462541 16536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:08.462596 16536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.469069 16536 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:40579
I20260929 06:34:08.469123 16664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:40579 every 8 connection(s)
I20260929 06:34:08.469468 16536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:34:08.471731 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 16536
I20260929 06:34:08.471894 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 15888
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.125@KRBTEST.COM
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.124@KRBTEST.COM
I20260929 06:34:08.478929 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:43651
--local_ip_for_outbound_sockets=127.9.61.67
--tserver_master_addrs=127.9.61.126:36609
--webserver_port=44335
--webserver_interface=127.9.61.67
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab
--principal=oryx/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.61.126:36609,127.9.61.125:42211
--tserver_master_addrs=127.9.61.126:36609,127.9.61.125:42211,127.9.61.124:39313 with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:08.481858 16534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.470325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:56977 (local address 127.9.61.124:39313)
0929 06:34:08.470369 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.470371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.470677 (+ 306us) server_negotiation.cc:407] Connection header received
0929 06:34:08.471303 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.471304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.471318 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.471382 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.472362 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.473092 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.474168 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.474425 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.474490 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.478708 (+ 4218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.478709 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.478709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.478717 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.480551 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.480954 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.480955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.480956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.481013 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.481248 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.481249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.481249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.481376 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.481417 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.481652 (+ 235us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.481753 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:34:08.481918 16670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.470193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:42211 (local address 127.9.61.66:45331)
0929 06:34:08.470619 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.470628 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.471030 (+ 402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.471623 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.471625 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.472441 (+ 816us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.472516 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.472518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.473356 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.473357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.474328 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.474331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.474740 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.474741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.474805 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.475314 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.475319 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.477240 (+ 1921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.479537 (+ 2297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.479543 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.479545 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.480518 (+ 973us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.480759 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.480760 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.480760 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.480879 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.481197 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.481204 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.481358 (+ 154us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.481464 (+ 106us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.481672 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":276,"thread_start_us":73,"threads_started":1}
I20260929 06:34:08.481992 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.470450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:45331 (local address 127.9.61.125:42211)
0929 06:34:08.470493 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.470495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.470679 (+ 184us) server_negotiation.cc:407] Connection header received
0929 06:34:08.471149 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.471151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.471164 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.471235 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.472617 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.473279 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.474415 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.474661 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.474739 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.477428 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.477430 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.477430 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.477436 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.478987 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.480618 (+ 1631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.480620 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.480620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.480683 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.480959 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.480960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.480961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.481106 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.481162 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.481808 (+ 646us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.481886 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:34:08.482218 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.470193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:39313 (local address 127.9.61.66:56977)
0929 06:34:08.470593 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.470610 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.471027 (+ 417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.471436 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.471437 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.472230 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.472287 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.472288 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.473209 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.473210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.474050 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.474052 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.474493 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.474494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.474642 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.475153 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.475162 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.478616 (+ 3454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.480648 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.480649 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.480649 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.480872 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.481102 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.481103 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.481103 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.481164 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.481464 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.481465 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.481507 (+ 42us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.481974 (+ 467us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.482092 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":3,"thread_start_us":75,"threads_started":1}
I20260929 06:34:08.482590 16665 heartbeater.cc:347] Connected to a master server at 127.9.61.124:39313
I20260929 06:34:08.482666 16665 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:08.482797 16665 heartbeater.cc:511] Master 127.9.61.124:39313 requested a full tablet report, sending...
I20260929 06:34:08.483112 16667 heartbeater.cc:347] Connected to a master server at 127.9.61.125:42211
I20260929 06:34:08.483163 16667 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:08.483237 16667 heartbeater.cc:511] Master 127.9.61.125:42211 requested a full tablet report, sending...
I20260929 06:34:08.483249 16359 ts_manager.cc:194] Registered new tserver with Master: 64a5b1fcee224070b0ef36b33985af23 (127.9.61.66:40579)
I20260929 06:34:08.483541 16156 ts_manager.cc:194] Registered new tserver with Master: 64a5b1fcee224070b0ef36b33985af23 (127.9.61.66:40579)
I20260929 06:34:08.484602 16669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.470193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.66:33821)
0929 06:34:08.470401 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.470445 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.471027 (+ 582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.471335 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.471340 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.471841 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.472120 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.472125 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.477355 (+ 5230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.477356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.478263 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.478265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.479149 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.479150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.479224 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.479682 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.479687 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.481205 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.483073 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.483074 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.483075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.483620 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.483842 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.483843 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.483843 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.483905 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.484286 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.484287 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.484335 (+ 48us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.484402 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.484500 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":88,"threads_started":1}
I20260929 06:34:08.484628 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.470257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:33821 (local address 127.9.61.126:36609)
0929 06:34:08.470316 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.470318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.470520 (+ 202us) server_negotiation.cc:407] Connection header received
0929 06:34:08.471211 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.471212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.471236 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.471289 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.476454 (+ 5165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.477248 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.478727 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.479026 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.479073 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.481292 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.481293 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.481293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.481300 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.482987 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.483710 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.483711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.483711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.483770 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.483996 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.483998 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.483998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.484186 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.484256 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.484444 (+ 188us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.484518 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 06:34:08.485134 16666 heartbeater.cc:347] Connected to a master server at 127.9.61.126:36609
I20260929 06:34:08.485186 16666 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:08.485247 16666 heartbeater.cc:511] Master 127.9.61.126:36609 requested a full tablet report, sending...
I20260929 06:34:08.485483 15558 ts_manager.cc:194] Re-registered known tserver with Master: 64a5b1fcee224070b0ef36b33985af23 (127.9.61.66:40579)
I20260929 06:34:08.486028 15558 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:33821
W20260929 06:34:08.561987 16672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:08.562176 16672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:08.562198 16672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:08.563380 16672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:08.563421 16672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:08.563446 16672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:34:08.564873 16672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab
--principal=oryx/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:43651
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=44335
--tserver_master_addrs=127.9.61.126:36609,127.9.61.125:42211,127.9.61.124:39313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:08.565097 16672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:08.565292 16672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:08.570683 16680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:08.570760 16672 server_base.cc:1034] running on GCE node
W20260929 06:34:08.570659 16677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:08.570658 16678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:08.571067 16672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:08.571310 16672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:08.572469 16672 hybrid_clock.cc:648] HybridClock initialized: now 1790663648572450 us; error 31 us; skew 500 ppm
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:08.574957 16672 init.cc:377] Logged in from keytab as oryx/127.9.61.67@KRBTEST.COM (short username oryx)
I20260929 06:34:08.575435 16672 webserver.cc:460] Webserver started at http://127.9.61.67:44335/ using document root <none> and password file <none>
I20260929 06:34:08.575652 16672 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:08.575733 16672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:08.577135 16672 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:08.577724 16687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.577896 16672 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:08.577991 16672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "d5a59bfd5d004b008443bda693c91543"
format_stamp: "Formatted at 2026-09-29 06:34:07 on dist-test-slave-601b"
server_key: "d954ddfea77a294ddc3a47cc4e038008"
server_key_iv: "ba8cc15f9d543a0b36eef8f9b228a505"
server_key_version: "encryptionkey@0"
I20260929 06:34:08.578331 16672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:08.589496 16672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:08.591768 16672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:08.591928 16672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:08.592206 16672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:08.592505 16672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:08.592554 16672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.592586 16672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:08.592617 16672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:08.598278 16672 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:43651
I20260929 06:34:08.598348 16800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:43651 every 8 connection(s)
I20260929 06:34:08.598694 16672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.125@KRBTEST.COM
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.124@KRBTEST.COM
Sep 29 06:34:08 dist-test-slave-601b krb5kdc[15513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663648, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:08.606640 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 16672
I20260929 06:34:08.610532 16807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.599673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:42211 (local address 127.9.61.67:49011)
0929 06:34:08.599774 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.599784 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.600690 (+ 906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.600951 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.600956 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.601365 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.601549 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.601555 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.602538 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.602539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.603477 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.603479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.603896 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.603897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.603990 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.604407 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.604411 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.606933 (+ 2522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.608888 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.608896 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.608899 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.609229 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.609436 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.609437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.609437 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.609561 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.609833 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.609839 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.610004 (+ 165us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.610109 (+ 105us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.610299 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"mutex_wait_us":51,"thread_start_us":64,"threads_started":1}
I20260929 06:34:08.611042 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.599849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:49011 (local address 127.9.61.125:42211)
0929 06:34:08.599917 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.599919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.599928 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:08.600819 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.600820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.600834 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.600867 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.601673 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.602429 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.603592 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.603805 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.603836 (+ 31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.607040 (+ 3204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.607042 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.607042 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.607050 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.608803 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.609309 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.609310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.609311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.609370 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.609630 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.609630 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.609631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.609756 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.609810 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.610861 (+ 1051us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.610950 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 06:34:08.611609 16803 heartbeater.cc:347] Connected to a master server at 127.9.61.125:42211
I20260929 06:34:08.611737 16803 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:08.611976 16803 heartbeater.cc:511] Master 127.9.61.125:42211 requested a full tablet report, sending...
I20260929 06:34:08.612525 16156 ts_manager.cc:194] Registered new tserver with Master: d5a59bfd5d004b008443bda693c91543 (127.9.61.67:43651)
I20260929 06:34:08.612645 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.599390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:48235 (local address 127.9.61.126:36609)
0929 06:34:08.599449 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.599452 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.599673 (+ 221us) server_negotiation.cc:407] Connection header received
0929 06:34:08.600819 (+ 1146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.600820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.600833 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.600867 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.601672 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.602437 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.603615 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.604494 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.604569 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.607496 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.607497 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.607498 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.607505 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.610236 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.611498 (+ 1262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.611499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.611500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.611557 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.611751 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.611752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.611752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.611878 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.611919 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.612468 (+ 549us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.612548 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:34:08.612655 16805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.599373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.67:48235)
0929 06:34:08.599578 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.599589 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.600687 (+ 1098us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.600951 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.600956 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.601356 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.601549 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.601555 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.602527 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.602528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.603477 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.603479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.604577 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.604578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.604647 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.605110 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.605133 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.607397 (+ 2264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.611121 (+ 3724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.611122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.611122 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.611413 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.611623 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.611624 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.611624 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.611677 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.611986 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.611987 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.612039 (+ 52us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.612406 (+ 367us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.612522 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":61,"thread_start_us":89,"threads_started":1}
I20260929 06:34:08.613108 16806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.599373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:39313 (local address 127.9.61.67:35405)
0929 06:34:08.599536 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.599576 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.600688 (+ 1112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.600953 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.600957 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.601353 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:08.601548 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.601552 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.602308 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.602309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.603122 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.603124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.603524 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.603525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.603665 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.604274 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:08.604284 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:08.606487 (+ 2203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:08.611075 (+ 4588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.611076 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.611077 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.611365 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.611873 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:08.611874 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:08.611875 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:08.611935 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:08.612299 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:08.612300 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:08.612343 (+ 43us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.612443 (+ 100us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.612581 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":36,"thread_start_us":89,"threads_started":1}
I20260929 06:34:08.613570 16534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.599473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:35405 (local address 127.9.61.124:39313)
0929 06:34:08.599519 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.599521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.599655 (+ 134us) server_negotiation.cc:407] Connection header received
0929 06:34:08.600804 (+ 1149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.600805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.600818 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.600874 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.601658 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.602196 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.603216 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.603426 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.603514 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.606596 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.606598 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.606598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.606606 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.610993 (+ 4387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.611676 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.611677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.611678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.611754 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.612030 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.612031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.612032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.612151 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.612230 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.613394 (+ 1164us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.613479 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:34:08.613878 16801 heartbeater.cc:347] Connected to a master server at 127.9.61.124:39313
I20260929 06:34:08.613965 16801 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:08.614037 16801 heartbeater.cc:511] Master 127.9.61.124:39313 requested a full tablet report, sending...
I20260929 06:34:08.614207 16802 heartbeater.cc:347] Connected to a master server at 127.9.61.126:36609
I20260929 06:34:08.614243 16802 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:08.614289 16802 heartbeater.cc:511] Master 127.9.61.126:36609 requested a full tablet report, sending...
I20260929 06:34:08.614327 16359 ts_manager.cc:194] Registered new tserver with Master: d5a59bfd5d004b008443bda693c91543 (127.9.61.67:43651)
I20260929 06:34:08.614495 15558 ts_manager.cc:194] Re-registered known tserver with Master: d5a59bfd5d004b008443bda693c91543 (127.9.61.67:43651)
I20260929 06:34:08.615051 15558 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:48235
I20260929 06:34:08.617514 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.608153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33802 (local address 127.9.61.125:42211)
0929 06:34:08.608510 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.608512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.608520 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:34:08.608541 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.608542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.608555 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.608651 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.609382 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.610179 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.611476 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.611806 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.612140 (+ 334us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.613747 (+ 1607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.613748 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.613749 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.613755 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.616152 (+ 2397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.616549 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.616550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.616551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.616612 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.616830 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.616831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.616831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.616948 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.617294 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.617331 (+ 37us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.617412 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":53,"threads_started":1}
I20260929 06:34:08.618327 16116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.614739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:39313 (local address 127.0.0.1:50304)
0929 06:34:08.614819 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.614828 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.614861 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.615089 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.615090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.615091 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:08.615126 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.615127 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.616059 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.616060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.617358 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.617361 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.618155 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.618156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.618199 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.618202 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.618232 (+ 30us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.618262 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260929 06:34:08.618378 16534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.614925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50304 (local address 127.9.61.124:39313)
0929 06:34:08.614956 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.614957 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.614963 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:34:08.614981 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.614982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.615001 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.615052 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:08.615197 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.615986 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.617442 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.618067 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.618142 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.618225 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.618243 (+ 18us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.618278 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:34:08.618718 16374 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260929 06:34:08.618850 16407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7f3c408f0a443a8ad3a77e3f4cf2e20. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: NON_VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.618991 16407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:34:08.619102 16118 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 640ba75a0d5147af9b6a7d81577120f4 (127.9.61.124) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.619282 16374 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 640ba75a0d5147af9b6a7d81577120f4 (127.9.61.124) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.620107 16118 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.620206 16118 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:08.620306 16118 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.620369 16118 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:08.620422 16118 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.620481 16118 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:08.620846 16165 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 LEARNER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 640ba75a0d5147af9b6a7d81577120f4 (127.9.61.124) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.620950 16813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.607927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50298 (local address 127.9.61.124:39313)
0929 06:34:08.608104 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.608107 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.608273 (+ 166us) server_negotiation.cc:407] Connection header received
0929 06:34:08.608294 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.608295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.608309 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.608509 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.609276 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.610024 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.614034 (+ 4010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.614332 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.614395 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.617644 (+ 3249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.617645 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.617645 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.617652 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.619615 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.619978 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.619979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.619979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.620061 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.620263 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.620264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.620264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.620400 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.620491 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.620759 (+ 268us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.620842 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":75,"threads_started":1}
I20260929 06:34:08.621898 16309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.622011 16309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: This master's current role is: LEARNER
I20260929 06:34:08.621999 16407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: NON_VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: true } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.622072 16407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:34:08.622128 16117 raft_consensus.cc:1050] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20: attempting to promote NON_VOTER 2ebbf2d7fedb4aa6abc9e2ec7227cd3d to VOTER
I20260929 06:34:08.622254 16117 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } }
I20260929 06:34:08.622654 16374 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 FOLLOWER]: Refusing update from remote peer f7f3c408f0a443a8ad3a77e3f4cf2e20: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260929 06:34:08.622797 16165 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 LEARNER]: Refusing update from remote peer f7f3c408f0a443a8ad3a77e3f4cf2e20: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260929 06:34:08.622874 16313 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260929 06:34:08.622978 16118 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260929 06:34:08.623713 16313 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 2ebbf2d7fedb4aa6abc9e2ec7227cd3d (127.9.61.125) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.623832 16165 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 2ebbf2d7fedb4aa6abc9e2ec7227cd3d (127.9.61.125) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.624415 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.608398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33140 (local address 127.9.61.126:36609)
0929 06:34:08.612725 (+ 4327us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.612727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.612736 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:08.612758 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.612759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.612770 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.612840 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.613495 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.614467 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.615830 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.616155 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.616265 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.621212 (+ 4947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.621214 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.621214 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.621221 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.622955 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.623546 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.623547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.623547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.623609 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.623848 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.623849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.623850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.624024 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.624137 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.624241 (+ 104us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.624316 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4309,"thread_start_us":90,"threads_started":1}
I20260929 06:34:08.624684 16313 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.624751 16313 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:08.624738 16309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.624841 16309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:34:08.624833 16313 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.624882 16313 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:08.624850 16118 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.624925 16118 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:08.625257 16374 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 2ebbf2d7fedb4aa6abc9e2ec7227cd3d (127.9.61.125) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.626150 16407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:08.626231 16407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:34:08.626489 15558 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:34:08.628062 15558 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:34:08.634788 16116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.631121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:40579 (local address 127.0.0.1:43824)
0929 06:34:08.631327 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.631338 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.631379 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.632174 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.632175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.632177 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:08.632224 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.632226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.633063 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.633064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.633860 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.633862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.634564 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.634565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.634624 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.634629 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.634686 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.634725 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192}
I20260929 06:34:08.634822 16827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.631213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43824 (local address 127.9.61.66:40579)
0929 06:34:08.632003 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.632008 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.632018 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:34:08.632054 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.632056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.632072 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.632172 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:08.632280 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.632979 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.633961 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.634461 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.634555 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.634634 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.634701 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.634743 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":79,"threads_started":1}
I20260929 06:34:08.635674 16825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.631191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:43651 (local address 127.0.0.1:38252)
0929 06:34:08.631634 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.631643 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.631690 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.632090 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.632091 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.632093 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:08.632154 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.632156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.633414 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.633415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.634550 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.634552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.635448 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.635450 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.635510 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.635514 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.635570 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.635606 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":4,"thread_start_us":84,"threads_started":1}
I20260929 06:34:08.635721 16829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.631404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38252 (local address 127.9.61.67:43651)
0929 06:34:08.631773 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.631777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.631810 (+ 33us) server_negotiation.cc:407] Connection header received
0929 06:34:08.631851 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.631853 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.631873 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.631992 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:08.632241 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.633302 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.634646 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.635368 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.635444 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.635515 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.635594 (+ 79us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.635640 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":73,"threads_started":1}
I20260929 06:34:08.635718 16599 tablet_service.cc:1467] Processing CreateTablet for tablet 51c93c37aca146e1a97b1d657abba3a4 (DEFAULT_TABLE table=test-table [id=1ae50bcdb64348398721c5a8bdc15f4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:08.635856 16826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.631206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43577 (local address 127.0.0.1:33164)
0929 06:34:08.631794 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.631802 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.631847 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.632090 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.632091 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.632096 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:08.632154 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.632156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.633692 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.633693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.634744 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.634746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.635642 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.635643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.635703 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.635707 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.635738 (+ 31us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.635780 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":4,"thread_start_us":89,"threads_started":1}
I20260929 06:34:08.636135 16599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51c93c37aca146e1a97b1d657abba3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:08.636185 16828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.631318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33164 (local address 127.9.61.65:43577)
0929 06:34:08.631474 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.631480 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.631850 (+ 370us) server_negotiation.cc:407] Connection header received
0929 06:34:08.631979 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.631982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.631999 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.632086 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:08.632245 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.633582 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.634831 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.635526 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.635968 (+ 442us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.636046 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.636072 (+ 26us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.636113 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":96,"threads_started":1}
I20260929 06:34:08.636363 16735 tablet_service.cc:1467] Processing CreateTablet for tablet 51c93c37aca146e1a97b1d657abba3a4 (DEFAULT_TABLE table=test-table [id=1ae50bcdb64348398721c5a8bdc15f4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:08.636601 16735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51c93c37aca146e1a97b1d657abba3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:08.638628 16830 tablet_bootstrap.cc:492] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23: Bootstrap starting.
I20260929 06:34:08.638893 16831 tablet_bootstrap.cc:492] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543: Bootstrap starting.
I20260929 06:34:08.639341 16830 tablet_bootstrap.cc:654] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:08.639511 16831 tablet_bootstrap.cc:654] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:08.639681 16830 log.cc:824] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:08.639875 16831 log.cc:824] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:08.640149 16462 tablet_service.cc:1467] Processing CreateTablet for tablet 51c93c37aca146e1a97b1d657abba3a4 (DEFAULT_TABLE table=test-table [id=1ae50bcdb64348398721c5a8bdc15f4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:08.640493 16462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51c93c37aca146e1a97b1d657abba3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:08.640789 16831 tablet_bootstrap.cc:492] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543: No bootstrap required, opened a new log
I20260929 06:34:08.640789 16830 tablet_bootstrap.cc:492] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23: No bootstrap required, opened a new log
I20260929 06:34:08.640864 16831 ts_tablet_manager.cc:1397] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:34:08.640880 16830 ts_tablet_manager.cc:1397] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:34:08.642980 16830 raft_consensus.cc:348] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } }
I20260929 06:34:08.643150 16830 raft_consensus.cc:374] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:08.643193 16830 raft_consensus.cc:729] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a5b1fcee224070b0ef36b33985af23, State: Initialized, Role: FOLLOWER
I20260929 06:34:08.643313 16830 consensus_queue.cc:260] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } }
I20260929 06:34:08.643287 16831 raft_consensus.cc:348] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } }
I20260929 06:34:08.643443 16831 raft_consensus.cc:374] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:08.643478 16831 raft_consensus.cc:729] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5a59bfd5d004b008443bda693c91543, State: Initialized, Role: FOLLOWER
I20260929 06:34:08.643596 16830 ts_tablet_manager.cc:1428] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:34:08.643613 16831 consensus_queue.cc:260] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } }
I20260929 06:34:08.643678 16666 heartbeater.cc:503] Master 127.9.61.126:36609 was elected leader, sending a full tablet report...
I20260929 06:34:08.643852 16831 ts_tablet_manager.cc:1428] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:34:08.644088 16802 heartbeater.cc:503] Master 127.9.61.126:36609 was elected leader, sending a full tablet report...
I20260929 06:34:08.645349 16836 tablet_bootstrap.cc:492] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035: Bootstrap starting.
I20260929 06:34:08.645877 16836 tablet_bootstrap.cc:654] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:08.646230 16836 log.cc:824] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:08.646971 16836 tablet_bootstrap.cc:492] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035: No bootstrap required, opened a new log
I20260929 06:34:08.647024 16836 ts_tablet_manager.cc:1397] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:34:08.648833 16836 raft_consensus.cc:348] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } }
I20260929 06:34:08.648960 16836 raft_consensus.cc:374] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:08.649005 16836 raft_consensus.cc:729] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef697f01324e4f65854299d26cd23035, State: Initialized, Role: FOLLOWER
I20260929 06:34:08.649123 16836 consensus_queue.cc:260] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } }
I20260929 06:34:08.649384 16836 ts_tablet_manager.cc:1428] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:34:08.649443 16529 heartbeater.cc:503] Master 127.9.61.126:36609 was elected leader, sending a full tablet report...
I20260929 06:34:08.677546 16834 raft_consensus.cc:482] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:34:08.677673 16834 raft_consensus.cc:504] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } }
I20260929 06:34:08.678092 16834 leader_election.cc:288] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef697f01324e4f65854299d26cd23035 (127.9.61.65:43577), d5a59bfd5d004b008443bda693c91543 (127.9.61.67:43651)
I20260929 06:34:08.681169 16829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.678341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:36495 (local address 127.9.61.67:43651)
0929 06:34:08.678386 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.678389 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.678398 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:08.678500 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.678500 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.678520 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.678594 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:08.678791 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.679247 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.680357 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.680802 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.680877 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.680888 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.681049 (+ 161us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.681090 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:34:08.681198 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.678292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:43651 (local address 127.9.61.66:36495)
0929 06:34:08.678355 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.678367 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.678410 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.678617 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.678618 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.678621 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:08.678693 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.678695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.679365 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.679366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.680261 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.680264 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.680884 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.680885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.680964 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.680968 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.681032 (+ 64us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.681079 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260929 06:34:08.681207 16828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.678322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:53867 (local address 127.9.61.65:43577)
0929 06:34:08.678368 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.678370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.678410 (+ 40us) server_negotiation.cc:407] Connection header received
0929 06:34:08.678494 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.678495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.678509 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.678563 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:08.678740 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.679232 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.680385 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.680804 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.680896 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.680906 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.681096 (+ 190us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.681144 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:34:08.681457 16669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.678253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43577 (local address 127.9.61.66:53867)
0929 06:34:08.678353 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:08.678366 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:08.678425 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:08.678590 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:08.678591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:08.678593 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:08.678673 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.678674 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.679319 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.679320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.680282 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:08.680284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.680906 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.680907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:08.681006 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.681010 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:08.681065 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 06:34:08.681100 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260929 06:34:08.681509 16755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51c93c37aca146e1a97b1d657abba3a4" candidate_uuid: "64a5b1fcee224070b0ef36b33985af23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5a59bfd5d004b008443bda693c91543" is_pre_election: true
I20260929 06:34:08.681660 16755 raft_consensus.cc:2454] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64a5b1fcee224070b0ef36b33985af23 in term 0.
I20260929 06:34:08.681815 16482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51c93c37aca146e1a97b1d657abba3a4" candidate_uuid: "64a5b1fcee224070b0ef36b33985af23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef697f01324e4f65854299d26cd23035" is_pre_election: true
I20260929 06:34:08.681941 16482 raft_consensus.cc:2454] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64a5b1fcee224070b0ef36b33985af23 in term 0.
I20260929 06:34:08.681919 16552 leader_election.cc:302] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64a5b1fcee224070b0ef36b33985af23, d5a59bfd5d004b008443bda693c91543; no voters:
I20260929 06:34:08.682024 16834 raft_consensus.cc:2781] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:34:08.682096 16834 raft_consensus.cc:482] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:34:08.682137 16834 raft_consensus.cc:3037] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:08.682849 16834 raft_consensus.cc:504] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } }
I20260929 06:34:08.683009 16834 leader_election.cc:288] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [CANDIDATE]: Term 1 election: Requested vote from peers ef697f01324e4f65854299d26cd23035 (127.9.61.65:43577), d5a59bfd5d004b008443bda693c91543 (127.9.61.67:43651)
I20260929 06:34:08.683145 16482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51c93c37aca146e1a97b1d657abba3a4" candidate_uuid: "64a5b1fcee224070b0ef36b33985af23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef697f01324e4f65854299d26cd23035"
I20260929 06:34:08.683154 16755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51c93c37aca146e1a97b1d657abba3a4" candidate_uuid: "64a5b1fcee224070b0ef36b33985af23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5a59bfd5d004b008443bda693c91543"
I20260929 06:34:08.683226 16755 raft_consensus.cc:3037] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:08.683243 16482 raft_consensus.cc:3037] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:08.683903 16755 raft_consensus.cc:2454] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64a5b1fcee224070b0ef36b33985af23 in term 1.
I20260929 06:34:08.684079 16482 raft_consensus.cc:2454] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64a5b1fcee224070b0ef36b33985af23 in term 1.
I20260929 06:34:08.684082 16552 leader_election.cc:302] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64a5b1fcee224070b0ef36b33985af23, d5a59bfd5d004b008443bda693c91543; no voters:
I20260929 06:34:08.684186 16834 raft_consensus.cc:2781] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:08.684393 16834 raft_consensus.cc:686] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 1 LEADER]: Becoming Leader. State: Replica: 64a5b1fcee224070b0ef36b33985af23, State: Running, Role: LEADER
I20260929 06:34:08.684494 16834 consensus_queue.cc:237] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } }
I20260929 06:34:08.685252 15558 catalog_manager.cc:5495] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64a5b1fcee224070b0ef36b33985af23 (127.9.61.66). New cstate: current_term: 1 leader_uuid: "64a5b1fcee224070b0ef36b33985af23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } health_report { overall_health: UNKNOWN } } }
I20260929 06:34:08.696208 16827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.694039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43830 (local address 127.9.61.66:40579)
0929 06:34:08.694099 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.694101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.694118 (+ 17us) server_negotiation.cc:407] Connection header received
0929 06:34:08.694152 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.694153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.694169 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.694227 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:34:08.694344 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.694789 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.695469 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.695666 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.695722 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.695853 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:34:08.695995 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:34:08.696066 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.696087 (+ 21us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.696106 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 06:34:08.697934 16482 raft_consensus.cc:1261] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035 [term 1 FOLLOWER]: Refusing update from remote peer 64a5b1fcee224070b0ef36b33985af23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:08.697934 16755 raft_consensus.cc:1261] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543 [term 1 FOLLOWER]: Refusing update from remote peer 64a5b1fcee224070b0ef36b33985af23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:08.698247 16834 consensus_queue.cc:1035] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:08.698408 16839 consensus_queue.cc:1035] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:08.701732 16843 mvcc.cc:205] Tried to move back new op lower bound from 7334558305063985152 to 7334558305012289536. Current Snapshot: MvccSnapshot[applied={T|T < 7334558305063985152}]
I20260929 06:34:08.701877 16842 mvcc.cc:205] Tried to move back new op lower bound from 7334558305063985152 to 7334558305012289536. Current Snapshot: MvccSnapshot[applied={T|T < 7334558305063985152}]
I20260929 06:34:08.705340 15557 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:08.705435 15557 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:08.706789 15557 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7f3c408f0a443a8ad3a77e3f4cf2e20: Sending DeleteTablet for 3 replicas of tablet 51c93c37aca146e1a97b1d657abba3a4
I20260929 06:34:08.707114 16735 tablet_service.cc:1514] Processing DeleteTablet for tablet 51c93c37aca146e1a97b1d657abba3a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:08 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:38252
I20260929 06:34:08.707279 16462 tablet_service.cc:1514] Processing DeleteTablet for tablet 51c93c37aca146e1a97b1d657abba3a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:08 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:33164
I20260929 06:34:08.707522 16853 tablet_replica.cc:330] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035: stopping tablet replica
I20260929 06:34:08.707574 16599 tablet_service.cc:1514] Processing DeleteTablet for tablet 51c93c37aca146e1a97b1d657abba3a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:08 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:43824
I20260929 06:34:08.707729 16853 raft_consensus.cc:2229] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:08.707799 16854 tablet_replica.cc:330] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23: stopping tablet replica
I20260929 06:34:08.707899 16853 raft_consensus.cc:2258] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:08.708542 16853 ts_tablet_manager.cc:1905] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:08.708947 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 15526
I20260929 06:34:08.708050 16854 raft_consensus.cc:2229] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:34:08.710235 16854 raft_consensus.cc:2258] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:08.710749 16854 ts_tablet_manager.cc:1905] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:08.712463 16854 ts_tablet_manager.cc:1918] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:08.712548 16854 log.cc:1196] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/51c93c37aca146e1a97b1d657abba3a4
I20260929 06:34:08.712836 16854 ts_tablet_manager.cc:1939] T 51c93c37aca146e1a97b1d657abba3a4 P 64a5b1fcee224070b0ef36b33985af23: Deleting consensus metadata
I20260929 06:34:08.713433 16853 ts_tablet_manager.cc:1918] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:08.713503 16853 log.cc:1196] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-0/wal/wals/51c93c37aca146e1a97b1d657abba3a4
I20260929 06:34:08.713796 16853 ts_tablet_manager.cc:1939] T 51c93c37aca146e1a97b1d657abba3a4 P ef697f01324e4f65854299d26cd23035: Deleting consensus metadata
I20260929 06:34:08.714304 16852 tablet_replica.cc:330] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543: stopping tablet replica
I20260929 06:34:08.714466 16852 raft_consensus.cc:2229] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:08.714588 16852 raft_consensus.cc:2258] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:08.715114 16852 ts_tablet_manager.cc:1905] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260929 06:34:08.716707 16402 connection.cc:535] server connection from 127.0.0.1:33164 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 06:34:08.717042 16852 ts_tablet_manager.cc:1918] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:08.717118 16852 log.cc:1196] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/51c93c37aca146e1a97b1d657abba3a4
W20260929 06:34:08.717275 16552 connection.cc:535] server connection from 127.0.0.1:43824 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 06:34:08.717439 16852 ts_tablet_manager.cc:1939] T 51c93c37aca146e1a97b1d657abba3a4 P d5a59bfd5d004b008443bda693c91543: Deleting consensus metadata
W20260929 06:34:08.717823 16690 connection.cc:441] server connection from 127.0.0.1:38252 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38252 (request call id 1) could send its response
I20260929 06:34:08.718163 16813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.708208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50316 (local address 127.9.61.124:39313)
0929 06:34:08.708356 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.708358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.708880 (+ 522us) server_negotiation.cc:407] Connection header received
0929 06:34:08.708976 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.708977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.708993 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.709021 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.710652 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.711402 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.712586 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.712936 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.712984 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.714781 (+ 1797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.714782 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.714783 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.714808 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.716747 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.717208 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.717210 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.717210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.717270 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.717501 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.717502 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.717502 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.717648 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.717723 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.717951 (+ 228us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.718038 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260929 06:34:08.726294 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.719751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33818 (local address 127.9.61.125:42211)
0929 06:34:08.719796 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.719798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.719808 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:34:08.719845 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.719846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.719857 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.719924 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.720540 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.721044 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.721770 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.721996 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.722082 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.723370 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.723371 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.723372 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.723379 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.724975 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.725418 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.725420 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.725420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.725493 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.725715 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.725716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.725717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.725875 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.725970 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.726107 (+ 137us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.726194 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:34:08.728622 16813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:08.719695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50324 (local address 127.9.61.124:39313)
0929 06:34:08.719729 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:08.719731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:08.719921 (+ 190us) server_negotiation.cc:407] Connection header received
0929 06:34:08.720021 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:08.720022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:08.720033 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:08.720088 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:08.720755 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.721504 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.722561 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:08.722857 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:08.722911 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:08.725633 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:08.725634 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:08.725635 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:08.725642 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:08.727483 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.727831 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.727832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.727832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.727889 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:08.728142 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:08.728143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:08.728143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:08.728265 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:08.728354 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:08.728438 (+ 84us) server_negotiation.cc:299] Negotiation successful
0929 06:34:08.728510 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:34:09.703434 16862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:09.702817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.65:51055)
0929 06:34:09.703275 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:09.703383 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":80,"threads_started":1}
I20260929 06:34:09.703434 16863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:09.703030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.66:52251)
0929 06:34:09.703332 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:09.703387 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":52,"threads_started":1}
I20260929 06:34:09.703588 16864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:09.703104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.67:43635)
0929 06:34:09.703224 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:09.703540 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":51,"threads_started":1}
W20260929 06:34:09.703677 16529 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:36609 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
W20260929 06:34:09.703671 16666 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:36609 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
W20260929 06:34:09.703765 16802 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:36609 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
I20260929 06:34:10.207660 16866 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f7f3c408f0a443a8ad3a77e3f4cf2e20)
I20260929 06:34:10.207666 16865 raft_consensus.cc:482] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f7f3c408f0a443a8ad3a77e3f4cf2e20)
I20260929 06:34:10.207855 16865 raft_consensus.cc:504] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } }
I20260929 06:34:10.207864 16866 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } }
I20260929 06:34:10.208212 16865 leader_election.cc:288] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f7f3c408f0a443a8ad3a77e3f4cf2e20 (127.9.61.126:36609), 2ebbf2d7fedb4aa6abc9e2ec7227cd3d (127.9.61.125:42211)
I20260929 06:34:10.208544 16869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.208329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33674)
0929 06:34:10.208432 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.208483 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":44,"threads_started":1}
W20260929 06:34:10.208663 16336 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
I20260929 06:34:10.208884 16866 leader_election.cc:288] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f7f3c408f0a443a8ad3a77e3f4cf2e20 (127.9.61.126:36609), 640ba75a0d5147af9b6a7d81577120f4 (127.9.61.124:39313)
I20260929 06:34:10.209116 16868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.208328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33672)
0929 06:34:10.209032 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.209074 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":689,"thread_start_us":45,"threads_started":1}
W20260929 06:34:10.209216 16143 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
I20260929 06:34:10.209451 16870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.209355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33702)
0929 06:34:10.209393 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.209422 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260929 06:34:10.209522 16336 leader_election.cc:334] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f7f3c408f0a443a8ad3a77e3f4cf2e20 (127.9.61.126:36609): Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
I20260929 06:34:10.209713 16875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.209538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33704)
0929 06:34:10.209639 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.209671 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":68,"threads_started":1}
W20260929 06:34:10.209824 16143 leader_election.cc:334] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f7f3c408f0a443a8ad3a77e3f4cf2e20 (127.9.61.126:36609): Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
I20260929 06:34:10.211980 16871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.208558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33824 (local address 127.9.61.125:42211)
0929 06:34:10.208693 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:10.208695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:10.208968 (+ 273us) server_negotiation.cc:407] Connection header received
0929 06:34:10.208992 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:10.208993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:10.209003 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:10.209075 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:10.209244 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.209971 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.211223 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.211640 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.211717 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.211729 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:10.211862 (+ 133us) server_negotiation.cc:299] Negotiation successful
0929 06:34:10.211907 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":46,"threads_started":1}
I20260929 06:34:10.211982 16869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.208381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:42211 (local address 127.0.0.1:33824)
0929 06:34:10.208850 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.208860 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:10.208914 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:10.209107 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:10.209108 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:10.209111 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:10.209164 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.209166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.210056 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.210057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.211146 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.211149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.211719 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.211720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.211776 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.211781 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:34:10.211844 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 06:34:10.211887 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":43,"threads_started":1}
I20260929 06:34:10.212324 16165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "640ba75a0d5147af9b6a7d81577120f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" is_pre_election: true
I20260929 06:34:10.212422 16165 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 640ba75a0d5147af9b6a7d81577120f4 in term 1.
I20260929 06:34:10.212576 16867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.208336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:39313 (local address 127.0.0.1:50338)
0929 06:34:10.209073 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.209083 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:10.209143 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:10.209627 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:10.209628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:10.209630 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:10.209669 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.209671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.210391 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.210392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.211533 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.211536 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.212324 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.212325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.212386 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.212390 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:10.212459 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 06:34:10.212503 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"thread_start_us":42,"threads_started":1}
I20260929 06:34:10.212566 16334 leader_election.cc:302] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ebbf2d7fedb4aa6abc9e2ec7227cd3d, 640ba75a0d5147af9b6a7d81577120f4; no voters: f7f3c408f0a443a8ad3a77e3f4cf2e20
I20260929 06:34:10.212633 16872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.208556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50338 (local address 127.9.61.124:39313)
0929 06:34:10.209018 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:10.209020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:10.209129 (+ 109us) server_negotiation.cc:407] Connection header received
0929 06:34:10.209214 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:10.209215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:10.209225 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:10.209727 (+ 502us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:10.209758 (+ 31us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.210316 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.211643 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.212225 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.212320 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.212330 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:10.212501 (+ 171us) server_negotiation.cc:299] Negotiation successful
0929 06:34:10.212539 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":58,"threads_started":1}
I20260929 06:34:10.212703 16865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 06:34:10.212728 16865 raft_consensus.cc:482] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f7f3c408f0a443a8ad3a77e3f4cf2e20)
I20260929 06:34:10.212751 16865 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 1 FOLLOWER]: Advancing to term 2
I20260929 06:34:10.212939 16374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "640ba75a0d5147af9b6a7d81577120f4" is_pre_election: true
I20260929 06:34:10.213539 16865 raft_consensus.cc:504] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } }
I20260929 06:34:10.213675 16374 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ebbf2d7fedb4aa6abc9e2ec7227cd3d in current term 2: Already voted for candidate 640ba75a0d5147af9b6a7d81577120f4 in this term.
I20260929 06:34:10.213709 16865 leader_election.cc:288] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [CANDIDATE]: Term 2 election: Requested vote from peers f7f3c408f0a443a8ad3a77e3f4cf2e20 (127.9.61.126:36609), 2ebbf2d7fedb4aa6abc9e2ec7227cd3d (127.9.61.125:42211)
I20260929 06:34:10.213851 16869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.213774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33716)
0929 06:34:10.213810 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.213831 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260929 06:34:10.213842 16165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "640ba75a0d5147af9b6a7d81577120f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d"
I20260929 06:34:10.213882 16142 leader_election.cc:302] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ebbf2d7fedb4aa6abc9e2ec7227cd3d; no voters: 640ba75a0d5147af9b6a7d81577120f4, f7f3c408f0a443a8ad3a77e3f4cf2e20
I20260929 06:34:10.213902 16165 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 1 FOLLOWER]: Advancing to term 2
I20260929 06:34:10.214628 16165 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 640ba75a0d5147af9b6a7d81577120f4 in term 2.
I20260929 06:34:10.214742 16866 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:34:10.214890 16334 leader_election.cc:302] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ebbf2d7fedb4aa6abc9e2ec7227cd3d, 640ba75a0d5147af9b6a7d81577120f4; no voters:
I20260929 06:34:10.214946 16869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.214867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33720)
0929 06:34:10.214895 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.214923 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260929 06:34:10.214975 16865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 2 FOLLOWER]: Leader election won for term 2
W20260929 06:34:10.215003 16336 leader_election.cc:334] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f7f3c408f0a443a8ad3a77e3f4cf2e20 (127.9.61.126:36609): Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
I20260929 06:34:10.215134 16865 raft_consensus.cc:686] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [term 2 LEADER]: Becoming Leader. State: Replica: 640ba75a0d5147af9b6a7d81577120f4, State: Running, Role: LEADER
I20260929 06:34:10.215214 16865 consensus_queue.cc:237] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } }
I20260929 06:34:10.215601 16876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 640ba75a0d5147af9b6a7d81577120f4. Latest consensus state: current_term: 2 leader_uuid: "640ba75a0d5147af9b6a7d81577120f4" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:10.215679 16876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:10.215835 16878 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:10.216271 16878 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:10.216365 16878 catalog_manager.cc:1259] Loaded cluster ID: b1f9418de52a4e44a14261bfd7785b5f
I20260929 06:34:10.216398 16878 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:34:10.216572 16878 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:10.216684 16878 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: Loaded TSK: 0
I20260929 06:34:10.216822 16878 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:34:10.265980 16359 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:34:10.267581 16359 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:34:10.268735 16869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.268600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33738)
0929 06:34:10.268666 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.268702 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260929 06:34:10.268738 16165 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [term 2 FOLLOWER]: Refusing update from remote peer 640ba75a0d5147af9b6a7d81577120f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260929 06:34:10.268996 16876 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260929 06:34:10.269064 16869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.268966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.0.0.1:33742)
0929 06:34:10.269003 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.269030 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260929 06:34:10.269167 16336 consensus_peers.cc:487] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 -> Peer f7f3c408f0a443a8ad3a77e3f4cf2e20 (127.9.61.126:36609): Couldn't send request to peer f7f3c408f0a443a8ad3a77e3f4cf2e20. Status: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 06:34:10.269613 16866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 640ba75a0d5147af9b6a7d81577120f4. Latest consensus state: current_term: 2 leader_uuid: "640ba75a0d5147af9b6a7d81577120f4" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:10.269726 16866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:34:10.270139 16876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "640ba75a0d5147af9b6a7d81577120f4" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:10.270239 16876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:10.270321 16866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "640ba75a0d5147af9b6a7d81577120f4" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "f7f3c408f0a443a8ad3a77e3f4cf2e20" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36609 } } peers { permanent_uuid: "2ebbf2d7fedb4aa6abc9e2ec7227cd3d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 42211 } attrs { promote: false } } peers { permanent_uuid: "640ba75a0d5147af9b6a7d81577120f4" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 39313 } attrs { promote: false } } }
I20260929 06:34:10.270416 16866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ebbf2d7fedb4aa6abc9e2ec7227cd3d [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:34:10.270663 16880 mvcc.cc:205] Tried to move back new op lower bound from 7334558311498448896 to 7334558311282311168. Current Snapshot: MvccSnapshot[applied={T|T < 7334558311498448896 or (T in {7334558311498448896})}]
I20260929 06:34:10.275312 16886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.272464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33174 (local address 127.9.61.65:43577)
0929 06:34:10.272588 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:10.272591 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:10.272599 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:34:10.272622 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:10.272623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:10.272632 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:10.272698 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:10.272865 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.273470 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.274392 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.274956 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.275037 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.275051 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:10.275209 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 06:34:10.275247 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
I20260929 06:34:10.275311 16884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.272115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43577 (local address 127.0.0.1:33174)
0929 06:34:10.272362 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.272372 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:10.272422 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:10.272738 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:10.272739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:10.272740 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:10.272788 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.272789 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.273549 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.273550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.274300 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.274302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.275034 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.275035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.275110 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.275114 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:10.275196 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 06:34:10.275239 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":34}
I20260929 06:34:10.275638 16869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.272111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:43651 (local address 127.0.0.1:38262)
0929 06:34:10.272200 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.272210 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:10.272257 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:10.272579 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:10.272580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:10.272583 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:10.272634 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.272635 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.273567 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.273568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.274713 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.274715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.275442 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.275443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.275503 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.275508 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:34:10.275536 (+ 28us) client_negotiation.cc:240] Negotiation successful
0929 06:34:10.275574 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"mutex_wait_us":33}
I20260929 06:34:10.275800 16462 tablet_service.cc:1467] Processing CreateTablet for tablet 05a12c7aab77431781cc7428cc557e2c (DEFAULT_TABLE table=test-table [id=277febe7d95c4fe9ac59d92426f4e3ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:10.275902 16885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.272343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38262 (local address 127.9.61.67:43651)
0929 06:34:10.272452 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:10.272454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:10.272463 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:10.272490 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:10.272491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:10.272503 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:10.272566 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:10.272702 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.273473 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.274807 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.275358 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.275748 (+ 390us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.275764 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:10.275782 (+ 18us) server_negotiation.cc:299] Negotiation successful
0929 06:34:10.275818 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":66,"threads_started":1}
I20260929 06:34:10.275967 16462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05a12c7aab77431781cc7428cc557e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:10.275998 16870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.272240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:40579 (local address 127.0.0.1:43846)
0929 06:34:10.272361 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.272372 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:10.272422 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:10.273072 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:10.273073 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:10.273075 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:10.273112 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.273113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.273949 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.273949 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.275027 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.275029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.275782 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.275782 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.275836 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.275840 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:10.275868 (+ 28us) client_negotiation.cc:240] Negotiation successful
0929 06:34:10.275902 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":87,"threads_started":1}
I20260929 06:34:10.276226 16887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.272608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43846 (local address 127.9.61.66:40579)
0929 06:34:10.272943 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:10.272945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:10.272953 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:34:10.272977 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:10.272978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:10.272989 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:10.273052 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:10.273177 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.273858 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.275119 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.275692 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.276103 (+ 411us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.276117 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:10.276135 (+ 18us) server_negotiation.cc:299] Negotiation successful
0929 06:34:10.276179 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":56,"threads_started":1}
I20260929 06:34:10.277294 16735 tablet_service.cc:1467] Processing CreateTablet for tablet 05a12c7aab77431781cc7428cc557e2c (DEFAULT_TABLE table=test-table [id=277febe7d95c4fe9ac59d92426f4e3ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:10.277297 16888 tablet_bootstrap.cc:492] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035: Bootstrap starting.
I20260929 06:34:10.277431 16735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05a12c7aab77431781cc7428cc557e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:10.277624 16888 tablet_bootstrap.cc:654] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:10.278149 16888 tablet_bootstrap.cc:492] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035: No bootstrap required, opened a new log
I20260929 06:34:10.278196 16888 ts_tablet_manager.cc:1397] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:10.278293 16888 raft_consensus.cc:348] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } }
I20260929 06:34:10.278355 16888 raft_consensus.cc:374] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:10.278370 16888 raft_consensus.cc:729] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef697f01324e4f65854299d26cd23035, State: Initialized, Role: FOLLOWER
I20260929 06:34:10.278429 16888 consensus_queue.cc:260] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } }
I20260929 06:34:10.278573 16888 ts_tablet_manager.cc:1428] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:10.278949 16891 tablet_bootstrap.cc:492] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543: Bootstrap starting.
I20260929 06:34:10.279170 16528 heartbeater.cc:503] Master 127.9.61.124:39313 was elected leader, sending a full tablet report...
I20260929 06:34:10.279398 16892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.279136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.65:35275)
0929 06:34:10.279316 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.279356 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":80,"threads_started":1}
I20260929 06:34:10.279488 16891 tablet_bootstrap.cc:654] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:10.279753 16599 tablet_service.cc:1467] Processing CreateTablet for tablet 05a12c7aab77431781cc7428cc557e2c (DEFAULT_TABLE table=test-table [id=277febe7d95c4fe9ac59d92426f4e3ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:10.279876 16599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05a12c7aab77431781cc7428cc557e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:10.280174 16891 tablet_bootstrap.cc:492] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543: No bootstrap required, opened a new log
I20260929 06:34:10.280217 16891 ts_tablet_manager.cc:1397] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:10.280301 16891 raft_consensus.cc:348] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } }
I20260929 06:34:10.280350 16891 raft_consensus.cc:374] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:10.280364 16891 raft_consensus.cc:729] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5a59bfd5d004b008443bda693c91543, State: Initialized, Role: FOLLOWER
I20260929 06:34:10.280422 16891 consensus_queue.cc:260] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } }
I20260929 06:34:10.280654 16891 ts_tablet_manager.cc:1428] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:10.280956 16895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.280742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.67:38975)
0929 06:34:10.280883 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.280917 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":72,"threads_started":1}
I20260929 06:34:10.281224 16895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.281146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.67:53969)
0929 06:34:10.281178 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.281200 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260929 06:34:10.281386 16896 tablet_bootstrap.cc:492] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23: Bootstrap starting.
I20260929 06:34:10.281747 16801 heartbeater.cc:503] Master 127.9.61.124:39313 was elected leader, sending a full tablet report...
I20260929 06:34:10.281858 16896 tablet_bootstrap.cc:654] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:10.282366 16896 tablet_bootstrap.cc:492] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23: No bootstrap required, opened a new log
I20260929 06:34:10.282430 16896 ts_tablet_manager.cc:1397] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:10.282537 16896 raft_consensus.cc:348] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } }
I20260929 06:34:10.282609 16896 raft_consensus.cc:374] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:10.282634 16896 raft_consensus.cc:729] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a5b1fcee224070b0ef36b33985af23, State: Initialized, Role: FOLLOWER
I20260929 06:34:10.282696 16896 consensus_queue.cc:260] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } }
I20260929 06:34:10.282826 16896 ts_tablet_manager.cc:1428] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:10.283265 16899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.283065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.66:51407)
0929 06:34:10.283198 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.283230 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":94,"threads_started":1}
I20260929 06:34:10.283313 16665 heartbeater.cc:503] Master 127.9.61.124:39313 was elected leader, sending a full tablet report...
I20260929 06:34:10.283667 16899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.283580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.66:40755)
0929 06:34:10.283621 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.283643 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260929 06:34:10.306421 16894 raft_consensus.cc:482] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:34:10.306516 16894 raft_consensus.cc:504] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } }
I20260929 06:34:10.306813 16894 leader_election.cc:288] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef697f01324e4f65854299d26cd23035 (127.9.61.65:43577), 64a5b1fcee224070b0ef36b33985af23 (127.9.61.66:40579)
I20260929 06:34:10.310168 16895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.307049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43577 (local address 127.9.61.67:45629)
0929 06:34:10.307116 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.307131 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:10.307188 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:10.307339 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:10.307340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:10.307343 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:10.307432 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.307434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.308147 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.308148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.309009 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.309012 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.309830 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.309831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.309928 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.309933 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:34:10.310011 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 06:34:10.310055 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260929 06:34:10.310249 16886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.307118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:45629 (local address 127.9.61.65:43577)
0929 06:34:10.307183 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:10.307185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:10.307195 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:34:10.307258 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:10.307259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:10.307269 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:10.307331 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:10.307528 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.308068 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.309113 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.309756 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.309825 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.309839 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:10.310101 (+ 262us) server_negotiation.cc:299] Negotiation successful
0929 06:34:10.310146 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:34:10.310420 16482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a12c7aab77431781cc7428cc557e2c" candidate_uuid: "d5a59bfd5d004b008443bda693c91543" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef697f01324e4f65854299d26cd23035" is_pre_election: true
I20260929 06:34:10.310525 16482 raft_consensus.cc:2454] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5a59bfd5d004b008443bda693c91543 in term 0.
I20260929 06:34:10.310622 16900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.307184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:40579 (local address 127.9.61.67:56827)
0929 06:34:10.307366 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.307377 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:10.307436 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:10.307598 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:10.307599 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:10.307600 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:10.307666 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.307668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.308462 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.308464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.309516 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:10.309519 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.310373 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.310374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:10.310441 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.310445 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:10.310498 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:34:10.310533 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":116,"threads_started":1}
I20260929 06:34:10.310650 16887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.307274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:56827 (local address 127.9.61.66:40579)
0929 06:34:10.307337 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:10.307340 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:10.307442 (+ 102us) server_negotiation.cc:407] Connection header received
0929 06:34:10.307503 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:10.307504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:10.307517 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:10.307594 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:10.307754 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.308359 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.309644 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.310172 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.310239 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.310248 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:10.310524 (+ 276us) server_negotiation.cc:299] Negotiation successful
0929 06:34:10.310576 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260929 06:34:10.310703 16690 leader_election.cc:302] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5a59bfd5d004b008443bda693c91543, ef697f01324e4f65854299d26cd23035; no voters:
I20260929 06:34:10.310844 16894 raft_consensus.cc:2781] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:34:10.310886 16894 raft_consensus.cc:482] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:34:10.310911 16894 raft_consensus.cc:3037] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:10.310997 16619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a12c7aab77431781cc7428cc557e2c" candidate_uuid: "d5a59bfd5d004b008443bda693c91543" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64a5b1fcee224070b0ef36b33985af23" is_pre_election: true
I20260929 06:34:10.311159 16619 raft_consensus.cc:2454] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5a59bfd5d004b008443bda693c91543 in term 0.
I20260929 06:34:10.311832 16894 raft_consensus.cc:504] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } }
I20260929 06:34:10.311985 16894 leader_election.cc:288] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [CANDIDATE]: Term 1 election: Requested vote from peers ef697f01324e4f65854299d26cd23035 (127.9.61.65:43577), 64a5b1fcee224070b0ef36b33985af23 (127.9.61.66:40579)
I20260929 06:34:10.312203 16482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a12c7aab77431781cc7428cc557e2c" candidate_uuid: "d5a59bfd5d004b008443bda693c91543" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef697f01324e4f65854299d26cd23035"
I20260929 06:34:10.312273 16482 raft_consensus.cc:3037] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:10.312970 16482 raft_consensus.cc:2454] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5a59bfd5d004b008443bda693c91543 in term 1.
I20260929 06:34:10.313083 16619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a12c7aab77431781cc7428cc557e2c" candidate_uuid: "d5a59bfd5d004b008443bda693c91543" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64a5b1fcee224070b0ef36b33985af23"
I20260929 06:34:10.313133 16690 leader_election.cc:302] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5a59bfd5d004b008443bda693c91543, ef697f01324e4f65854299d26cd23035; no voters:
I20260929 06:34:10.313158 16619 raft_consensus.cc:3037] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:10.313225 16894 raft_consensus.cc:2781] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:10.313401 16894 raft_consensus.cc:686] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 1 LEADER]: Becoming Leader. State: Replica: d5a59bfd5d004b008443bda693c91543, State: Running, Role: LEADER
I20260929 06:34:10.313477 16894 consensus_queue.cc:237] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } } peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } }
I20260929 06:34:10.313827 16900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.313692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.67:50719)
0929 06:34:10.313755 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.313791 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260929 06:34:10.313925 16619 raft_consensus.cc:2454] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5a59bfd5d004b008443bda693c91543 in term 1.
I20260929 06:34:10.314235 16359 catalog_manager.cc:5495] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5a59bfd5d004b008443bda693c91543 (127.9.61.67). New cstate: current_term: 1 leader_uuid: "d5a59bfd5d004b008443bda693c91543" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59bfd5d004b008443bda693c91543" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 43651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 } health_report { overall_health: UNKNOWN } } }
I20260929 06:34:10.323467 16885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.321324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38274 (local address 127.9.61.67:43651)
0929 06:34:10.321385 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:10.321386 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:10.321394 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:34:10.321423 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:10.321433 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:10.321451 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:10.321511 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:34:10.321615 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.322060 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.322738 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:10.322941 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:10.322989 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:10.323115 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:34:10.323226 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:34:10.323287 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:10.323327 (+ 40us) server_negotiation.cc:299] Negotiation successful
0929 06:34:10.323344 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:34:10.324535 16482 raft_consensus.cc:1261] T 05a12c7aab77431781cc7428cc557e2c P ef697f01324e4f65854299d26cd23035 [term 1 FOLLOWER]: Refusing update from remote peer d5a59bfd5d004b008443bda693c91543: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:10.324630 16619 raft_consensus.cc:1261] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23 [term 1 FOLLOWER]: Refusing update from remote peer d5a59bfd5d004b008443bda693c91543: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:10.325009 16894 consensus_queue.cc:1035] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef697f01324e4f65854299d26cd23035" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:10.325142 16901 consensus_queue.cc:1035] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64a5b1fcee224070b0ef36b33985af23" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:10.326086 16899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.325967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.66:41537)
0929 06:34:10.326022 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.326052 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 06:34:10.326187 16892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.325967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.65:58495)
0929 06:34:10.326124 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.326154 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260929 06:34:10.326733 16900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.326617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.67:48361)
0929 06:34:10.326674 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.326707 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260929 06:34:10.327425 16892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.327332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.65:43629)
0929 06:34:10.327369 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.327393 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260929 06:34:10.327621 16905 mvcc.cc:205] Tried to move back new op lower bound from 7334558311727329280 to 7334558311684538368. Current Snapshot: MvccSnapshot[applied={T|T < 7334558311727329280}]
I20260929 06:34:10.328516 16900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.328402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.67:51587)
0929 06:34:10.328444 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.328471 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260929 06:34:10.329463 16899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.329363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36609 (local address 127.9.61.66:43315)
0929 06:34:10.329396 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.329429 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:36609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260929 06:34:10.329538 16359 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:10.329618 16359 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:10.330883 16359 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 640ba75a0d5147af9b6a7d81577120f4: Sending DeleteTablet for 3 replicas of tablet 05a12c7aab77431781cc7428cc557e2c
I20260929 06:34:10.331249 16735 tablet_service.cc:1514] Processing DeleteTablet for tablet 05a12c7aab77431781cc7428cc557e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:10 UTC) from {username='oryx', principal='oryx/127.9.61.124@KRBTEST.COM'} at 127.0.0.1:38262
I20260929 06:34:10.331267 16462 tablet_service.cc:1514] Processing DeleteTablet for tablet 05a12c7aab77431781cc7428cc557e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:10 UTC) from {username='oryx', principal='oryx/127.9.61.124@KRBTEST.COM'} at 127.0.0.1:33174
I20260929 06:34:10.331489 16916 tablet_replica.cc:330] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543: stopping tablet replica
I20260929 06:34:10.331544 16599 tablet_service.cc:1514] Processing DeleteTablet for tablet 05a12c7aab77431781cc7428cc557e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:10 UTC) from {username='oryx', principal='oryx/127.9.61.124@KRBTEST.COM'} at 127.0.0.1:43846
I20260929 06:34:10.331714 16917 tablet_replica.cc:330] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23: stopping tablet replica
I20260929 06:34:10.331781 16917 raft_consensus.cc:2229] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:10.331831 16917 raft_consensus.cc:2258] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:10.331868 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 16303
I20260929 06:34:10.332526 16917 ts_tablet_manager.cc:1905] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:10.334192 16917 ts_tablet_manager.cc:1918] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:10.334251 16917 log.cc:1196] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/05a12c7aab77431781cc7428cc557e2c
I20260929 06:34:10.334499 16917 ts_tablet_manager.cc:1939] T 05a12c7aab77431781cc7428cc557e2c P 64a5b1fcee224070b0ef36b33985af23: Deleting consensus metadata
I20260929 06:34:10.334801 16335 catalog_manager.cc:4841] TS 64a5b1fcee224070b0ef36b33985af23 (127.9.61.66:40579): tablet 05a12c7aab77431781cc7428cc557e2c (table test-table [id=277febe7d95c4fe9ac59d92426f4e3ec]) successfully deleted
I20260929 06:34:10.334944 16916 raft_consensus.cc:2229] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:34:10.335065 16916 raft_consensus.cc:2258] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:10.335347 16916 ts_tablet_manager.cc:1905] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:10.336983 16916 ts_tablet_manager.cc:1918] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:10.337049 16916 log.cc:1196] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/05a12c7aab77431781cc7428cc557e2c
I20260929 06:34:10.337280 16916 ts_tablet_manager.cc:1939] T 05a12c7aab77431781cc7428cc557e2c P d5a59bfd5d004b008443bda693c91543: Deleting consensus metadata
I20260929 06:34:10.337617 16333 catalog_manager.cc:4841] TS d5a59bfd5d004b008443bda693c91543 (127.9.61.67:43651): tablet 05a12c7aab77431781cc7428cc557e2c (table test-table [id=277febe7d95c4fe9ac59d92426f4e3ec]) successfully deleted
I20260929 06:34:10.339926 16870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:10.339813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43577 (local address 127.0.0.1:33176)
0929 06:34:10.339861 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:10.339891 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:43577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260929 06:34:10.339984 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 16536
W20260929 06:34:10.340106 16335 catalog_manager.cc:4584] TS ef697f01324e4f65854299d26cd23035 (127.9.61.65:43577): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 05a12c7aab77431781cc7428cc557e2c: Network error: Client connection negotiation failed: client connection to 127.9.61.65:43577: connect: Connection refused (error 111)
I20260929 06:34:10.348932 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 16672
I20260929 06:34:10.355294 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 16022
I20260929 06:34:10.360532 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 16210
2026-09-29T06:34:10Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4475 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:34:10 dist-test-slave-601b krb5kdc[16920](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:34:10 dist-test-slave-601b krb5kdc[16920](info): set up 2 sockets
Sep 29 06:34:10 dist-test-slave-601b krb5kdc[16920](info): commencing operation
krb5kdc: starting...
W20260929 06:34:11.404500 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:34:11 dist-test-slave-601b krb5kdc[16920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:34:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:11Z Disabled control of system clock
WARNING: no policy specified for oryx/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.126.keytab.
Entry for principal oryx/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.126.keytab.
I20260929 06:34:11.522943 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:44453
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.126.keytab
--principal=oryx/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:44453
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:11.603807 16933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:11.604049 16933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:11.604074 16933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:11.605266 16933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:11.605314 16933 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260929 06:34:11.605327 16933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:11.605340 16933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:11.605353 16933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:11.605365 16933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:11.606953 16933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:44453
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.126.keytab
--principal=oryx/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:44453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:11.607223 16933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:11.607496 16933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:11.612349 16939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:11.612339 16941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:11.612339 16938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:11.612669 16933 server_base.cc:1034] running on GCE node
I20260929 06:34:11.612872 16933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:11.613116 16933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:11.614293 16933 hybrid_clock.cc:648] HybridClock initialized: now 1790663651614273 us; error 36 us; skew 500 ppm
Sep 29 06:34:11 dist-test-slave-601b krb5kdc[16920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663651, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:11.617027 16933 init.cc:377] Logged in from keytab as oryx/127.9.61.126@KRBTEST.COM (short username oryx)
I20260929 06:34:11.617544 16933 webserver.cc:460] Webserver started at http://127.9.61.126:41329/ using document root <none> and password file <none>
I20260929 06:34:11.617794 16933 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:11.617863 16933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:11.618019 16933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:11.619136 16933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "cd2f2061d3484ec384e3fe535d15a5a1"
format_stamp: "Formatted at 2026-09-29 06:34:11 on dist-test-slave-601b"
server_key: "ab0550a170959aed8b4a0396e914cb12"
server_key_iv: "dad74d778d3caf872743f23c9d6db721"
server_key_version: "encryptionkey@0"
I20260929 06:34:11.619720 16933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "cd2f2061d3484ec384e3fe535d15a5a1"
format_stamp: "Formatted at 2026-09-29 06:34:11 on dist-test-slave-601b"
server_key: "ab0550a170959aed8b4a0396e914cb12"
server_key_iv: "dad74d778d3caf872743f23c9d6db721"
server_key_version: "encryptionkey@0"
I20260929 06:34:11.621454 16933 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:11.622335 16948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:11.622520 16933 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:11.622639 16933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "cd2f2061d3484ec384e3fe535d15a5a1"
format_stamp: "Formatted at 2026-09-29 06:34:11 on dist-test-slave-601b"
server_key: "ab0550a170959aed8b4a0396e914cb12"
server_key_iv: "dad74d778d3caf872743f23c9d6db721"
server_key_version: "encryptionkey@0"
I20260929 06:34:11.622723 16933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:11.650739 16933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:11.653679 16933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:11.653890 16933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:11.659310 16933 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:44453
I20260929 06:34:11.659387 17010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:44453 every 8 connection(s)
I20260929 06:34:11.659795 16933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:11.660619 17011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:11.663007 17011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1: Bootstrap starting.
I20260929 06:34:11.663659 17011 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:11.664047 17011 log.cc:824] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:11.664933 17011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1: No bootstrap required, opened a new log
I20260929 06:34:11.667095 17011 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2f2061d3484ec384e3fe535d15a5a1" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 44453 } }
I20260929 06:34:11.667251 17011 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:11.667275 17011 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd2f2061d3484ec384e3fe535d15a5a1, State: Initialized, Role: FOLLOWER
I20260929 06:34:11.667464 17011 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2f2061d3484ec384e3fe535d15a5a1" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 44453 } }
I20260929 06:34:11.667531 17011 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:11.667554 17011 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:11.667608 17011 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:11.668254 17011 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2f2061d3484ec384e3fe535d15a5a1" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 44453 } }
I20260929 06:34:11.668344 17011 leader_election.cc:302] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd2f2061d3484ec384e3fe535d15a5a1; no voters:
I20260929 06:34:11.668380 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 16933
I20260929 06:34:11.668504 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:11.668565 17011 leader_election.cc:288] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:11.668596 17014 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:11.668725 17014 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [term 1 LEADER]: Becoming Leader. State: Replica: cd2f2061d3484ec384e3fe535d15a5a1, State: Running, Role: LEADER
I20260929 06:34:11.668732 9461 external_mini_cluster.cc:1428] Setting key 812f7a8b5abfb0c7a16029bcc33ee138
I20260929 06:34:11.668810 17014 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2f2061d3484ec384e3fe535d15a5a1" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 44453 } }
I20260929 06:34:11.668850 17011 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:11.669131 17015 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd2f2061d3484ec384e3fe535d15a5a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2f2061d3484ec384e3fe535d15a5a1" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 44453 } } }
I20260929 06:34:11.669227 17015 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:11.669121 17014 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd2f2061d3484ec384e3fe535d15a5a1. Latest consensus state: current_term: 1 leader_uuid: "cd2f2061d3484ec384e3fe535d15a5a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2f2061d3484ec384e3fe535d15a5a1" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 44453 } } }
I20260929 06:34:11.669426 17014 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:11.669559 17020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:11.670388 17020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:11.672098 17020 catalog_manager.cc:1347] Generated new cluster ID: 2339d333f23748d094976e4689ec2af7
I20260929 06:34:11.672154 17020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:34:11 dist-test-slave-601b krb5kdc[16920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:11.679684 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:11.669304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53726 (local address 127.9.61.126:44453)
0929 06:34:11.669510 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:11.669521 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:11.669558 (+ 37us) server_negotiation.cc:407] Connection header received
0929 06:34:11.669808 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:11.669817 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:11.669908 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:11.670038 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:11.671051 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:11.672419 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:11.673198 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:11.673634 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:11.673758 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:11.676250 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:11.676254 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:11.676254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:11.676274 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:11.678060 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:11.678468 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:11.678471 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:11.678472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:11.678568 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:11.678778 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:11.678779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:11.678780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:11.679047 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:11.679235 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:11.679306 (+ 71us) server_negotiation.cc:299] Negotiation successful
0929 06:34:11.679457 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":84,"threads_started":1}
I20260929 06:34:11.682327 17020 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:11.683105 17020 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:11.690580 17020 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1: Generated new TSK 0
I20260929 06:34:11.690871 17020 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab.
Entry for principal oryx/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab.
I20260929 06:34:11.726845 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:44453
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab
--principal=oryx/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:11.821884 17037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:11.822120 17037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:11.822145 17037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:11.823280 17037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:11.823318 17037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:11.823336 17037 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:34:11.823356 17037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:34:11.824874 17037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab
--principal=oryx/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.61.126:44453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:11.825067 17037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:11.825255 17037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:11.830245 17045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:11.830245 17043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:11.830389 17037 server_base.cc:1034] running on GCE node
W20260929 06:34:11.830236 17042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:11.830687 17037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:11.830943 17037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:11.832104 17037 hybrid_clock.cc:648] HybridClock initialized: now 1790663651832101 us; error 38 us; skew 500 ppm
Sep 29 06:34:11 dist-test-slave-601b krb5kdc[16920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663651, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:11.834628 17037 init.cc:377] Logged in from keytab as oryx/127.9.61.65@KRBTEST.COM (short username oryx)
I20260929 06:34:11.835086 17037 webserver.cc:460] Webserver started at http://127.9.61.65:40749/ using document root <none> and password file <none>
I20260929 06:34:11.835273 17037 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:11.835314 17037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:11.835409 17037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:11.836511 17037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "21f39941deab4dacaf77ed7abf4d4d5a"
format_stamp: "Formatted at 2026-09-29 06:34:11 on dist-test-slave-601b"
server_key: "e251d866c53210956ed18f072d582af8"
server_key_iv: "837a60903ca4340ed333a153b9707fe7"
server_key_version: "encryptionkey@0"
I20260929 06:34:11.836817 17037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "21f39941deab4dacaf77ed7abf4d4d5a"
format_stamp: "Formatted at 2026-09-29 06:34:11 on dist-test-slave-601b"
server_key: "e251d866c53210956ed18f072d582af8"
server_key_iv: "837a60903ca4340ed333a153b9707fe7"
server_key_version: "encryptionkey@0"
I20260929 06:34:11.838131 17037 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:34:11.838827 17052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:11.839023 17037 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:11.839112 17037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "21f39941deab4dacaf77ed7abf4d4d5a"
format_stamp: "Formatted at 2026-09-29 06:34:11 on dist-test-slave-601b"
server_key: "e251d866c53210956ed18f072d582af8"
server_key_iv: "837a60903ca4340ed333a153b9707fe7"
server_key_version: "encryptionkey@0"
I20260929 06:34:11.839186 17037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:11.853600 17037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:11.856180 17037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:11.856345 17037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:11.856959 17037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:11.857002 17037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:11.857024 17037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:11.857038 17037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:34:11 dist-test-slave-601b krb5kdc[16920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663651, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:11.864502 17037 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:39103
I20260929 06:34:11.864624 17167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:39103 every 8 connection(s)
I20260929 06:34:11.864910 17037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:34:11.867667 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:11.857454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:55203 (local address 127.9.61.126:44453)
0929 06:34:11.857536 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:11.857539 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:11.857695 (+ 156us) server_negotiation.cc:407] Connection header received
0929 06:34:11.858380 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:11.858381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:11.858402 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:11.858484 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:11.859466 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:11.860362 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:11.861463 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:11.861698 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:11.861794 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:11.864711 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:11.864713 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:11.864714 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:11.864724 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:11.866330 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:11.866776 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:11.866777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:11.866777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:11.866831 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:11.867086 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:11.867088 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:11.867088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:11.867213 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:11.867275 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:11.867530 (+ 255us) server_negotiation.cc:299] Negotiation successful
0929 06:34:11.867603 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 06:34:11.867867 17061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:11.857396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:44453 (local address 127.9.61.65:55203)
0929 06:34:11.857553 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:11.857596 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:11.858220 (+ 624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:11.858595 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:11.858599 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:11.859036 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:11.859351 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:11.859357 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:11.860459 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:11.860461 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:11.861362 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:11.861364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:11.861821 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:11.861822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:11.861949 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:11.862579 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:11.862589 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:11.864603 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:11.866424 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:11.866430 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:11.866432 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:11.866701 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:11.866892 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:11.866893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:11.866893 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:11.866997 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:11.867280 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:11.867284 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:11.867413 (+ 129us) client_negotiation.cc:769] Sending connection context
0929 06:34:11.867498 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 06:34:11.867622 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":87,"threads_started":1}
I20260929 06:34:11.868440 17168 heartbeater.cc:347] Connected to a master server at 127.9.61.126:44453
I20260929 06:34:11.868597 17168 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:11.868805 17168 heartbeater.cc:511] Master 127.9.61.126:44453 requested a full tablet report, sending...
I20260929 06:34:11.869495 16964 ts_manager.cc:194] Registered new tserver with Master: 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103)
I20260929 06:34:11.870419 16964 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:55203
I20260929 06:34:11.872699 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 17037
I20260929 06:34:11.872843 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:34:11.873090 9461 external_mini_cluster.cc:1428] Setting key c87bf24cef183abf44fba52d077200d2
I20260929 06:34:11.875551 17174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:11.869545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:44453 (local address 127.9.61.65:46117)
0929 06:34:11.869689 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:11.869702 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:11.869766 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:11.869900 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:11.869900 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:11.870090 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:11.870153 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:11.870155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:11.870897 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:11.870898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:11.871460 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:11.871462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:11.871855 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:11.871856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:11.871931 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:11.872414 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:11.872418 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:11.872709 (+ 291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:11.874483 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:11.874484 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:11.874485 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:11.874663 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:11.874886 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:11.874887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:11.874888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:11.874953 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:11.875199 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:11.875200 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:11.875250 (+ 50us) client_negotiation.cc:769] Sending connection context
0929 06:34:11.875344 (+ 94us) client_negotiation.cc:240] Negotiation successful
0929 06:34:11.875451 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":27,"thread_start_us":88,"threads_started":1}
I20260929 06:34:11.875546 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:11.869584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:46117 (local address 127.9.61.126:44453)
0929 06:34:11.869670 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:11.869672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:11.869756 (+ 84us) server_negotiation.cc:407] Connection header received
0929 06:34:11.869815 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:11.869816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:11.869826 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:11.869892 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:11.870221 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:11.870767 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:11.871566 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:11.871779 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:11.871855 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:11.872799 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:11.872800 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:11.872801 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:11.872809 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:11.874389 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:11.874749 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:11.874750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:11.874750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:11.874812 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:11.875016 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:11.875017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:11.875018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:11.875131 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:11.875207 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:11.875370 (+ 163us) server_negotiation.cc:299] Negotiation successful
0929 06:34:11.875451 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
WARNING: no policy specified for oryx/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab.
Entry for principal oryx/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab.
I20260929 06:34:11.899726 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:44453
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab
--principal=oryx/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:11.983793 17177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:11.984115 17177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:11.984148 17177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:11.985345 17177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:11.985397 17177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:11.985419 17177 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:34:11.985437 17177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:34:11.987004 17177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab
--principal=oryx/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.61.126:44453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:11.987272 17177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:11.987541 17177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:11.992596 17182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:11.992596 17185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:11.992616 17183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:11.992614 17177 server_base.cc:1034] running on GCE node
I20260929 06:34:11.992937 17177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:11.993155 17177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:11.994290 17177 hybrid_clock.cc:648] HybridClock initialized: now 1790663651994282 us; error 29 us; skew 500 ppm
Sep 29 06:34:11 dist-test-slave-601b krb5kdc[16920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663651, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:11.997207 17177 init.cc:377] Logged in from keytab as oryx/127.9.61.66@KRBTEST.COM (short username oryx)
I20260929 06:34:11.997750 17177 webserver.cc:460] Webserver started at http://127.9.61.66:39263/ using document root <none> and password file <none>
I20260929 06:34:11.998044 17177 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:11.998107 17177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:11.998270 17177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:12.000077 17177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "6cfd4374f84d467a9cfefd2f85f236bd"
format_stamp: "Formatted at 2026-09-29 06:34:11 on dist-test-slave-601b"
server_key: "57bc6df0d1c5883392de5b1baf7c06f8"
server_key_iv: "76be342d0717e0a9affe22e90565a4b3"
server_key_version: "encryptionkey@0"
I20260929 06:34:12.000521 17177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "6cfd4374f84d467a9cfefd2f85f236bd"
format_stamp: "Formatted at 2026-09-29 06:34:11 on dist-test-slave-601b"
server_key: "57bc6df0d1c5883392de5b1baf7c06f8"
server_key_iv: "76be342d0717e0a9affe22e90565a4b3"
server_key_version: "encryptionkey@0"
I20260929 06:34:12.002379 17177 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260929 06:34:12.003334 17192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:12.003511 17177 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:12.003615 17177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "6cfd4374f84d467a9cfefd2f85f236bd"
format_stamp: "Formatted at 2026-09-29 06:34:11 on dist-test-slave-601b"
server_key: "57bc6df0d1c5883392de5b1baf7c06f8"
server_key_iv: "76be342d0717e0a9affe22e90565a4b3"
server_key_version: "encryptionkey@0"
I20260929 06:34:12.003706 17177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:12.033138 17177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:12.035580 17177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:12.035738 17177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:12.036322 17177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:12.036393 17177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:12.036438 17177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:12.036465 17177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 29 06:34:12 dist-test-slave-601b krb5kdc[16920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663651, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:12.043661 17177 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:43801
I20260929 06:34:12.043789 17307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:43801 every 8 connection(s)
I20260929 06:34:12.044102 17177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:34:12.045001 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 17177
I20260929 06:34:12.045107 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:34:12.045269 9461 external_mini_cluster.cc:1428] Setting key 7d9647dafbefa219b8f4713185562cd2
I20260929 06:34:12.047469 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.036849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:32855 (local address 127.9.61.126:44453)
0929 06:34:12.036938 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.036942 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.037110 (+ 168us) server_negotiation.cc:407] Connection header received
0929 06:34:12.037612 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.037614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.037626 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.037722 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:12.038394 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.039235 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.040565 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.040816 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.040899 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.043732 (+ 2833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:12.043734 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:12.043734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:12.043743 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:12.046061 (+ 2318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.046431 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.046433 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.046433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.046498 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.046727 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.046727 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.046728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.046899 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:12.046971 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.047250 (+ 279us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.047342 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260929 06:34:12.047557 17201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.036818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:44453 (local address 127.9.61.66:32855)
0929 06:34:12.036971 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.037013 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.037512 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.037818 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.037823 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.038095 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:12.038277 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.038282 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.039354 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.039356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.040454 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.040457 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.040918 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.040919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.041046 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.041560 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:12.041570 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:12.043627 (+ 2057us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:12.046139 (+ 2512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:12.046144 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:12.046146 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:12.046354 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:12.046577 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:12.046577 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:12.046578 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:12.046665 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:12.046970 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:12.046974 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:12.047081 (+ 107us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.047162 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.047274 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":78,"threads_started":1}
I20260929 06:34:12.048130 17308 heartbeater.cc:347] Connected to a master server at 127.9.61.126:44453
I20260929 06:34:12.048251 17308 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:12.048465 17308 heartbeater.cc:511] Master 127.9.61.126:44453 requested a full tablet report, sending...
I20260929 06:34:12.048877 16964 ts_manager.cc:194] Registered new tserver with Master: 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66:43801)
I20260929 06:34:12.049255 16964 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:32855
WARNING: no policy specified for oryx/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.67@KRBTEST.COM" created.
I20260929 06:34:12.060335 17315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.054093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:44453 (local address 127.9.61.66:35195)
0929 06:34:12.054214 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.054224 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.054278 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.054370 (+ 92us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.054371 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.054516 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:12.054579 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.054580 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.055257 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.055258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.055820 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.055822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.056258 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.056259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.056315 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.056844 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:12.056851 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:12.057313 (+ 462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:12.059231 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:12.059232 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:12.059233 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:12.059389 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:12.059595 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:12.059595 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:12.059595 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:12.059644 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:12.060026 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:12.060026 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:12.060095 (+ 69us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.060184 (+ 89us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.060262 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":72,"threads_started":1}
I20260929 06:34:12.060451 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.054132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:35195 (local address 127.9.61.126:44453)
0929 06:34:12.054203 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.054204 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.054287 (+ 83us) server_negotiation.cc:407] Connection header received
0929 06:34:12.054310 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.054310 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.054318 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.054368 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:12.054636 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.055176 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.055914 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.056162 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.056220 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.057404 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:12.057405 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:12.057406 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:12.057412 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:12.059149 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.059465 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.059466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.059466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.059528 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.059706 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.059707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.059707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.059923 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:12.060025 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.060237 (+ 212us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.060324 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab.
Entry for principal oryx/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab.
I20260929 06:34:12.072645 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:44453
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab
--principal=oryx/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:12.152253 17317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:12.152456 17317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:12.152479 17317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:12.153627 17317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:12.153669 17317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:12.153689 17317 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260929 06:34:12.153744 17317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:34:12.155304 17317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab
--principal=oryx/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.61.126:44453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:12.155539 17317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:12.155761 17317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:12.160640 17325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:12.160660 17322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:12.160655 17323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:12.160818 17317 server_base.cc:1034] running on GCE node
I20260929 06:34:12.161005 17317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:12.161188 17317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:12.162367 17317 hybrid_clock.cc:648] HybridClock initialized: now 1790663652162358 us; error 38 us; skew 500 ppm
Sep 29 06:34:12 dist-test-slave-601b krb5kdc[16920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663652, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:12.164749 17317 init.cc:377] Logged in from keytab as oryx/127.9.61.67@KRBTEST.COM (short username oryx)
I20260929 06:34:12.165177 17317 webserver.cc:460] Webserver started at http://127.9.61.67:33041/ using document root <none> and password file <none>
I20260929 06:34:12.165405 17317 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:12.165481 17317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:12.165632 17317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:12.166728 17317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "76c34496b6b24f39ae2dfcfd83c21b6e"
format_stamp: "Formatted at 2026-09-29 06:34:12 on dist-test-slave-601b"
server_key: "e2ace470ef099939f63a6ce462934d36"
server_key_iv: "54e68d1fdf7067b27f1bfddff146ee77"
server_key_version: "encryptionkey@0"
I20260929 06:34:12.167073 17317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "76c34496b6b24f39ae2dfcfd83c21b6e"
format_stamp: "Formatted at 2026-09-29 06:34:12 on dist-test-slave-601b"
server_key: "e2ace470ef099939f63a6ce462934d36"
server_key_iv: "54e68d1fdf7067b27f1bfddff146ee77"
server_key_version: "encryptionkey@0"
I20260929 06:34:12.168540 17317 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:34:12.169275 17332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:12.169502 17317 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:12.169579 17317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "76c34496b6b24f39ae2dfcfd83c21b6e"
format_stamp: "Formatted at 2026-09-29 06:34:12 on dist-test-slave-601b"
server_key: "e2ace470ef099939f63a6ce462934d36"
server_key_iv: "54e68d1fdf7067b27f1bfddff146ee77"
server_key_version: "encryptionkey@0"
I20260929 06:34:12.169629 17317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:12.182700 17317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:12.185029 17317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:12.185142 17317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:12.185609 17317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:12.185645 17317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:12.185673 17317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:12.185729 17317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:12.192615 17317 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:39609
I20260929 06:34:12.192688 17447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:39609 every 8 connection(s)
I20260929 06:34:12.193020 17317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:34:12 dist-test-slave-601b krb5kdc[16920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663652, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:12.196056 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.186131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:42111 (local address 127.9.61.126:44453)
0929 06:34:12.186204 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.186208 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.186360 (+ 152us) server_negotiation.cc:407] Connection header received
0929 06:34:12.187044 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.187046 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.187061 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.187153 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:12.188140 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.188993 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.190590 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.190867 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.190964 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.193642 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:12.193644 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:12.193644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:12.193651 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:12.194781 (+ 1130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.195189 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.195190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.195190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.195248 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.195467 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.195467 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.195468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.195580 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:12.195633 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.195839 (+ 206us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.195902 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 06:34:12.196206 17341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.186092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:44453 (local address 127.9.61.67:42111)
0929 06:34:12.186233 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.186272 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.186827 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.187258 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.187262 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.187667 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:12.188024 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.188031 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.189126 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.189127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.190504 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.190507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.190973 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.190974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.191103 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.191697 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:12.191708 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:12.193550 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:12.194848 (+ 1298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:12.194853 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:12.194854 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:12.195083 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:12.195315 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:12.195315 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:12.195315 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:12.195409 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:12.195637 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:12.195641 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:12.195748 (+ 107us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.195826 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.195985 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":74,"threads_started":1}
I20260929 06:34:12.196683 17448 heartbeater.cc:347] Connected to a master server at 127.9.61.126:44453
I20260929 06:34:12.196776 17448 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:12.196955 17448 heartbeater.cc:511] Master 127.9.61.126:44453 requested a full tablet report, sending...
I20260929 06:34:12.196982 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 17317
I20260929 06:34:12.197077 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:34:12.197309 9461 external_mini_cluster.cc:1428] Setting key c886ce5ac523b313dc1046ce48b9671c
I20260929 06:34:12.197654 16964 ts_manager.cc:194] Registered new tserver with Master: 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67:39609)
I20260929 06:34:12.198153 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:34:12.198158 16964 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:42111
I20260929 06:34:12.203590 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.197789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:55753 (local address 127.9.61.126:44453)
0929 06:34:12.197827 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.197829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.198050 (+ 221us) server_negotiation.cc:407] Connection header received
0929 06:34:12.198115 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.198116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.198126 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.198169 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:12.198545 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.199007 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.199697 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.200011 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.200079 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.200935 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:12.200937 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:12.200937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:12.200944 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:12.202487 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.202850 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.202851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.202852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.202910 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.203112 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.203113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.203114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.203242 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:12.203304 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.203478 (+ 174us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.203533 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:34:12.203758 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.197830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:44453 (local address 127.9.61.67:55753)
0929 06:34:12.197994 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.198005 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.198059 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.198171 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.198171 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.198404 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:12.198460 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.198462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.199095 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.199096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.199611 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.199612 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.200080 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.200081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.200132 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.200573 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:12.200577 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:12.200850 (+ 273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:12.202590 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:12.202591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:12.202592 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:12.202762 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:12.202972 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:12.202973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:12.202973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:12.203024 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:12.203318 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:12.203319 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:12.203372 (+ 53us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.203462 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.203592 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":112,"threads_started":1}
Sep 29 06:34:12 dist-test-slave-601b krb5kdc[16920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663652, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 29 06:34:12 dist-test-slave-601b krb5kdc[16920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:12 dist-test-slave-601b krb5kdc[16920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
W20260929 06:34:12.220068 17022 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:12.214800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53728 (local address 127.9.61.126:44453)
0929 06:34:12.214863 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.214865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.214875 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:34:12.214903 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.214904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.214921 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.214973 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:12.215515 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.216082 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.216806 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.216989 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.217041 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.219936 (+ 2895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53728: BlockingRecv error: recv got EOF from 127.0.0.1:53728 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Sep 29 06:34:12 dist-test-slave-601b krb5kdc[16920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663652, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:12.227702 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.220962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53732 (local address 127.9.61.126:44453)
0929 06:34:12.221036 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.221038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.221105 (+ 67us) server_negotiation.cc:407] Connection header received
0929 06:34:12.221173 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.221174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.221184 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.221256 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:12.221722 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.222193 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.222895 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.223089 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.223166 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.225327 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:12.225329 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:12.225330 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:12.225338 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:12.226638 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.227041 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.227042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.227042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.227097 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.227285 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.227285 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.227285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.227389 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:12.227474 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.227566 (+ 92us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.227627 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260929 06:34:12.229275 16964 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53732:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:34:12.230875 16964 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:34:12.237890 17470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.233276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:39609 (local address 127.0.0.1:36150)
0929 06:34:12.233394 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.233435 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.233504 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.233872 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.233875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.233878 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:12.233976 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.233978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.235245 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.235246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.236661 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.236662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.237489 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.237489 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.237544 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.237555 (+ 11us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.237672 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.237748 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":66,"thread_start_us":72,"threads_started":1}
I20260929 06:34:12.237864 17473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.233475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36150 (local address 127.9.61.67:39609)
0929 06:34:12.233666 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.233672 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.233682 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:34:12.233723 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.233725 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.233740 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.233847 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:12.234051 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.235140 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.236731 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.237408 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.237482 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.237562 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.237688 (+ 126us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.237734 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260929 06:34:12.238535 17471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.233282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:39103 (local address 127.0.0.1:53202)
0929 06:34:12.234031 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.234040 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.234085 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.234311 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.234312 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.234314 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:12.234362 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.234364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.235198 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.235199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.236659 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.236662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.238303 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.238303 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.238367 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.238371 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.238432 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.238470 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"mutex_wait_us":93,"thread_start_us":97,"threads_started":1}
I20260929 06:34:12.238612 17474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.233546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53202 (local address 127.9.61.65:39103)
0929 06:34:12.233753 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.233759 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.234084 (+ 325us) server_negotiation.cc:407] Connection header received
0929 06:34:12.234157 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.234159 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.234174 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.234244 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:12.234423 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.235108 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.237600 (+ 2492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.238221 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.238293 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.238366 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.238449 (+ 83us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.238489 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":110,"threads_started":1}
I20260929 06:34:12.238674 17382 tablet_service.cc:1467] Processing CreateTablet for tablet 209d1adf514542998eb4fdc4ad26503f (DEFAULT_TABLE table=test-table [id=7e917ecb147e4c25846bcd4da0fcf12c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:12.239081 17382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 209d1adf514542998eb4fdc4ad26503f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.239266 17102 tablet_service.cc:1467] Processing CreateTablet for tablet 209d1adf514542998eb4fdc4ad26503f (DEFAULT_TABLE table=test-table [id=7e917ecb147e4c25846bcd4da0fcf12c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:12.239578 17102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 209d1adf514542998eb4fdc4ad26503f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.240259 17472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.233282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43801 (local address 127.0.0.1:38854)
0929 06:34:12.233882 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.233892 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.233948 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.234364 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.234365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.234367 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:12.234423 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.234425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.235538 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.235539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.236555 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.236557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.238076 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.238076 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.238135 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.238138 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.240142 (+ 2004us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.240190 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"spinlock_wait_cycles":384,"thread_start_us":100,"threads_started":1}
I20260929 06:34:12.240321 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.233705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38854 (local address 127.9.61.66:43801)
0929 06:34:12.233880 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.233884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.233937 (+ 53us) server_negotiation.cc:407] Connection header received
0929 06:34:12.234007 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.234027 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.234223 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.234298 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:12.234500 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.235460 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.236652 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.237384 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.237482 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.237566 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.240171 (+ 2605us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.240219 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":89,"threads_started":1}
I20260929 06:34:12.241005 17242 tablet_service.cc:1467] Processing CreateTablet for tablet 209d1adf514542998eb4fdc4ad26503f (DEFAULT_TABLE table=test-table [id=7e917ecb147e4c25846bcd4da0fcf12c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:12.241372 17242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 209d1adf514542998eb4fdc4ad26503f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.243135 17476 tablet_bootstrap.cc:492] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e: Bootstrap starting.
I20260929 06:34:12.243475 17477 tablet_bootstrap.cc:492] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a: Bootstrap starting.
I20260929 06:34:12.244078 17477 tablet_bootstrap.cc:654] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.244091 17476 tablet_bootstrap.cc:654] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.244385 17477 log.cc:824] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:12.244436 17476 log.cc:824] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:12.245138 17477 tablet_bootstrap.cc:492] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a: No bootstrap required, opened a new log
I20260929 06:34:12.245229 17477 ts_tablet_manager.cc:1397] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:34:12.245229 17476 tablet_bootstrap.cc:492] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e: No bootstrap required, opened a new log
I20260929 06:34:12.245290 17476 ts_tablet_manager.cc:1397] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:34:12.245517 17480 tablet_bootstrap.cc:492] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd: Bootstrap starting.
I20260929 06:34:12.246152 17480 tablet_bootstrap.cc:654] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.246536 17480 log.cc:824] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:12.246949 17476 raft_consensus.cc:348] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } }
I20260929 06:34:12.247128 17476 raft_consensus.cc:374] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.247160 17476 raft_consensus.cc:729] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76c34496b6b24f39ae2dfcfd83c21b6e, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.247287 17476 consensus_queue.cc:260] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } }
I20260929 06:34:12.247340 17477 raft_consensus.cc:348] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } }
I20260929 06:34:12.247507 17477 raft_consensus.cc:374] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.247551 17477 raft_consensus.cc:729] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21f39941deab4dacaf77ed7abf4d4d5a, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.247571 17476 ts_tablet_manager.cc:1428] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:34:12.247692 17448 heartbeater.cc:503] Master 127.9.61.126:44453 was elected leader, sending a full tablet report...
I20260929 06:34:12.247666 17477 consensus_queue.cc:260] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } }
I20260929 06:34:12.247928 17477 ts_tablet_manager.cc:1428] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:34:12.248000 17168 heartbeater.cc:503] Master 127.9.61.126:44453 was elected leader, sending a full tablet report...
I20260929 06:34:12.248216 17480 tablet_bootstrap.cc:492] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd: No bootstrap required, opened a new log
I20260929 06:34:12.248302 17480 ts_tablet_manager.cc:1397] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 06:34:12.249965 17480 raft_consensus.cc:348] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } }
I20260929 06:34:12.250108 17480 raft_consensus.cc:374] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.250150 17480 raft_consensus.cc:729] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cfd4374f84d467a9cfefd2f85f236bd, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.250253 17480 consensus_queue.cc:260] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } }
I20260929 06:34:12.250527 17480 ts_tablet_manager.cc:1428] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:34:12.250550 17308 heartbeater.cc:503] Master 127.9.61.126:44453 was elected leader, sending a full tablet report...
I20260929 06:34:12.252523 17482 raft_consensus.cc:482] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:34:12.252589 17482 raft_consensus.cc:504] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } }
I20260929 06:34:12.252833 17482 leader_election.cc:288] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103), 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66:43801)
I20260929 06:34:12.255641 17474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.253022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:34125 (local address 127.9.61.65:39103)
0929 06:34:12.253153 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.253155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.253254 (+ 99us) server_negotiation.cc:407] Connection header received
0929 06:34:12.253317 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.253318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.253328 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.253383 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:12.253547 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.253998 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.254904 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.255265 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.255363 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.255373 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.255537 (+ 164us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.255571 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260929 06:34:12.255646 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.253112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:49019 (local address 127.9.61.66:43801)
0929 06:34:12.253204 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.253206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.253212 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:34:12.253247 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.253248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.253256 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.253321 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:12.253472 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.253947 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.254907 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.255268 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.255368 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.255377 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.255543 (+ 166us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.255579 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260929 06:34:12.255678 17485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.252988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:39103 (local address 127.9.61.67:34125)
0929 06:34:12.253148 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.253158 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.253266 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.253387 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.253387 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.253389 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:12.253476 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.253477 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.254083 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.254084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.254818 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.254819 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.255366 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.255366 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.255441 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.255456 (+ 15us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.255529 (+ 73us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.255571 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":33,"thread_start_us":80,"threads_started":1}
I20260929 06:34:12.255689 17341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.252987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43801 (local address 127.9.61.67:49019)
0929 06:34:12.253031 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.253044 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.253087 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.253334 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.253335 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.253336 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:12.253397 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.253399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.254031 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.254032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.254797 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.254799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.255373 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.255374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.255459 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.255462 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.255536 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.255579 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260929 06:34:12.256032 17262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209d1adf514542998eb4fdc4ad26503f" candidate_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" is_pre_election: true
I20260929 06:34:12.256165 17262 raft_consensus.cc:2454] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76c34496b6b24f39ae2dfcfd83c21b6e in term 0.
I20260929 06:34:12.256188 17122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209d1adf514542998eb4fdc4ad26503f" candidate_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" is_pre_election: true
I20260929 06:34:12.256335 17122 raft_consensus.cc:2454] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76c34496b6b24f39ae2dfcfd83c21b6e in term 0.
I20260929 06:34:12.256343 17334 leader_election.cc:302] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cfd4374f84d467a9cfefd2f85f236bd, 76c34496b6b24f39ae2dfcfd83c21b6e; no voters:
I20260929 06:34:12.256474 17482 raft_consensus.cc:2781] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:34:12.256541 17482 raft_consensus.cc:482] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:34:12.256567 17482 raft_consensus.cc:3037] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.257611 17482 raft_consensus.cc:504] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } }
I20260929 06:34:12.257754 17482 leader_election.cc:288] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [CANDIDATE]: Term 1 election: Requested vote from peers 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103), 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66:43801)
I20260929 06:34:12.257893 17122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209d1adf514542998eb4fdc4ad26503f" candidate_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21f39941deab4dacaf77ed7abf4d4d5a"
I20260929 06:34:12.257906 17262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209d1adf514542998eb4fdc4ad26503f" candidate_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cfd4374f84d467a9cfefd2f85f236bd"
I20260929 06:34:12.257969 17122 raft_consensus.cc:3037] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.258000 17262 raft_consensus.cc:3037] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.258701 17122 raft_consensus.cc:2454] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76c34496b6b24f39ae2dfcfd83c21b6e in term 1.
I20260929 06:34:12.258817 17262 raft_consensus.cc:2454] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76c34496b6b24f39ae2dfcfd83c21b6e in term 1.
I20260929 06:34:12.258878 17333 leader_election.cc:302] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21f39941deab4dacaf77ed7abf4d4d5a, 76c34496b6b24f39ae2dfcfd83c21b6e; no voters:
I20260929 06:34:12.258982 17482 raft_consensus.cc:2781] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:12.259097 17482 raft_consensus.cc:686] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 LEADER]: Becoming Leader. State: Replica: 76c34496b6b24f39ae2dfcfd83c21b6e, State: Running, Role: LEADER
I20260929 06:34:12.259189 17482 consensus_queue.cc:237] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } }
I20260929 06:34:12.259974 16965 catalog_manager.cc:5495] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67). New cstate: current_term: 1 leader_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } health_report { overall_health: UNKNOWN } } }
I20260929 06:34:12.267299 17473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.265180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36154 (local address 127.9.61.67:39609)
0929 06:34:12.265240 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.265242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.265249 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:34:12.265305 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.265310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.265325 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.265382 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:34:12.265488 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.265937 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.266645 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.266814 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.266862 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.266997 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:34:12.267086 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:34:12.267142 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.267178 (+ 36us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.267195 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:34:12.269209 17122 raft_consensus.cc:1261] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Refusing update from remote peer 76c34496b6b24f39ae2dfcfd83c21b6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:12.269258 17262 raft_consensus.cc:1261] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Refusing update from remote peer 76c34496b6b24f39ae2dfcfd83c21b6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:12.269600 17482 consensus_queue.cc:1035] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:12.269747 17486 consensus_queue.cc:1035] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:12.272119 17489 mvcc.cc:205] Tried to move back new op lower bound from 7334558319692177408 to 7334558319654449152. Current Snapshot: MvccSnapshot[applied={T|T < 7334558319692177408}]
I20260929 06:34:12.272207 17490 mvcc.cc:205] Tried to move back new op lower bound from 7334558319692177408 to 7334558319654449152. Current Snapshot: MvccSnapshot[applied={T|T < 7334558319692177408}]
I20260929 06:34:12.272333 17491 mvcc.cc:205] Tried to move back new op lower bound from 7334558319692177408 to 7334558319654449152. Current Snapshot: MvccSnapshot[applied={T|T < 7334558319692177408}]
I20260929 06:34:12.274550 16965 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53732:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:12.274627 16965 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53732:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:12.275341 16965 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1: Sending DeleteTablet for 3 replicas of tablet 209d1adf514542998eb4fdc4ad26503f
I20260929 06:34:12.275642 17102 tablet_service.cc:1514] Processing DeleteTablet for tablet 209d1adf514542998eb4fdc4ad26503f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:12 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:53202
I20260929 06:34:12.275682 17242 tablet_service.cc:1514] Processing DeleteTablet for tablet 209d1adf514542998eb4fdc4ad26503f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:12 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:38854
I20260929 06:34:12.275851 17382 tablet_service.cc:1514] Processing DeleteTablet for tablet 209d1adf514542998eb4fdc4ad26503f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:12 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:36150
I20260929 06:34:12.276081 17501 tablet_replica.cc:330] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e: stopping tablet replica
I20260929 06:34:12.276227 17501 raft_consensus.cc:2229] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:34:12.276368 17501 raft_consensus.cc:2258] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:12.276371 17499 tablet_replica.cc:330] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a: stopping tablet replica
I20260929 06:34:12.276299 16965 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53732:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260929 06:34:12.276455 17499 raft_consensus.cc:2229] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260929 06:34:12.276460 16965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:34:12.276556 17499 raft_consensus.cc:2258] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:12.277025 17501 ts_tablet_manager.cc:1905] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:12.277621 17242 tablet_service.cc:1467] Processing CreateTablet for tablet 12b2d81686914774b1e21ea4d5d33457 (DEFAULT_TABLE table=test-table [id=f95e76418c9d4871a28ceacf92801a9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:12.277621 17102 tablet_service.cc:1467] Processing CreateTablet for tablet 12b2d81686914774b1e21ea4d5d33457 (DEFAULT_TABLE table=test-table [id=f95e76418c9d4871a28ceacf92801a9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:12.277659 17382 tablet_service.cc:1467] Processing CreateTablet for tablet 12b2d81686914774b1e21ea4d5d33457 (DEFAULT_TABLE table=test-table [id=f95e76418c9d4871a28ceacf92801a9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:12.277738 17102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12b2d81686914774b1e21ea4d5d33457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.277738 17242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12b2d81686914774b1e21ea4d5d33457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.277763 17382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12b2d81686914774b1e21ea4d5d33457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.279101 17476 tablet_bootstrap.cc:492] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e: Bootstrap starting.
I20260929 06:34:12.279125 17477 tablet_bootstrap.cc:492] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a: Bootstrap starting.
I20260929 06:34:12.279520 17476 tablet_bootstrap.cc:654] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.279557 17477 tablet_bootstrap.cc:654] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.279597 17480 tablet_bootstrap.cc:492] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd: Bootstrap starting.
I20260929 06:34:12.279543 17499 ts_tablet_manager.cc:1905] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:12.280012 17480 tablet_bootstrap.cc:654] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.281195 17500 tablet_replica.cc:330] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd: stopping tablet replica
I20260929 06:34:12.281276 17500 raft_consensus.cc:2229] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:12.281353 17500 raft_consensus.cc:2258] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:12.281489 17499 ts_tablet_manager.cc:1918] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:12.281598 17499 log.cc:1196] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/wal/wals/209d1adf514542998eb4fdc4ad26503f
I20260929 06:34:12.281755 17477 tablet_bootstrap.cc:492] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a: No bootstrap required, opened a new log
I20260929 06:34:12.281810 17477 ts_tablet_manager.cc:1397] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260929 06:34:12.281811 17500 ts_tablet_manager.cc:1905] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:12.281977 17477 raft_consensus.cc:348] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.282056 17477 raft_consensus.cc:374] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.282084 17477 raft_consensus.cc:729] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21f39941deab4dacaf77ed7abf4d4d5a, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.282123 17477 consensus_queue.cc:260] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.282207 17477 ts_tablet_manager.cc:1428] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 06:34:12.282145 17499 ts_tablet_manager.cc:1939] T 209d1adf514542998eb4fdc4ad26503f P 21f39941deab4dacaf77ed7abf4d4d5a: Deleting consensus metadata
I20260929 06:34:12.282734 17501 ts_tablet_manager.cc:1918] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:12.282749 16949 catalog_manager.cc:4841] TS 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103): tablet 209d1adf514542998eb4fdc4ad26503f (table test-table [id=7e917ecb147e4c25846bcd4da0fcf12c]) successfully deleted
I20260929 06:34:12.282902 17501 log.cc:1196] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/209d1adf514542998eb4fdc4ad26503f
I20260929 06:34:12.283185 17501 ts_tablet_manager.cc:1939] T 209d1adf514542998eb4fdc4ad26503f P 76c34496b6b24f39ae2dfcfd83c21b6e: Deleting consensus metadata
I20260929 06:34:12.283584 17500 ts_tablet_manager.cc:1918] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:12.283581 16952 catalog_manager.cc:4841] TS 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67:39609): tablet 209d1adf514542998eb4fdc4ad26503f (table test-table [id=7e917ecb147e4c25846bcd4da0fcf12c]) successfully deleted
I20260929 06:34:12.283653 17500 log.cc:1196] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/209d1adf514542998eb4fdc4ad26503f
I20260929 06:34:12.283790 17476 tablet_bootstrap.cc:492] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e: No bootstrap required, opened a new log
I20260929 06:34:12.283843 17476 ts_tablet_manager.cc:1397] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260929 06:34:12.283927 17500 ts_tablet_manager.cc:1939] T 209d1adf514542998eb4fdc4ad26503f P 6cfd4374f84d467a9cfefd2f85f236bd: Deleting consensus metadata
I20260929 06:34:12.284021 17476 raft_consensus.cc:348] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.284096 17476 raft_consensus.cc:374] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.284117 17476 raft_consensus.cc:729] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76c34496b6b24f39ae2dfcfd83c21b6e, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.284157 17476 consensus_queue.cc:260] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.284251 17476 ts_tablet_manager.cc:1428] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:12.284353 16950 catalog_manager.cc:4841] TS 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66:43801): tablet 209d1adf514542998eb4fdc4ad26503f (table test-table [id=7e917ecb147e4c25846bcd4da0fcf12c]) successfully deleted
I20260929 06:34:12.291296 17480 tablet_bootstrap.cc:492] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd: No bootstrap required, opened a new log
I20260929 06:34:12.291361 17480 ts_tablet_manager.cc:1397] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s
I20260929 06:34:12.291519 17480 raft_consensus.cc:348] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.291592 17480 raft_consensus.cc:374] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.291617 17480 raft_consensus.cc:729] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cfd4374f84d467a9cfefd2f85f236bd, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.291666 17480 consensus_queue.cc:260] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.291751 17480 ts_tablet_manager.cc:1428] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
W20260929 06:34:12.294602 17309 tablet.cc:2369] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:34:12.317277 17484 raft_consensus.cc:482] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:34:12.317385 17484 raft_consensus.cc:504] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.317739 17484 leader_election.cc:288] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103), 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67:39609)
I20260929 06:34:12.321364 17201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.317900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:39609 (local address 127.9.61.66:47971)
0929 06:34:12.317977 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.317990 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.318032 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.318238 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.318239 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.318240 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:12.318320 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.318323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.319104 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.319105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.320325 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.320328 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.321106 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.321107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.321180 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.321184 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.321241 (+ 57us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.321291 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260929 06:34:12.321369 17473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.318033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:47971 (local address 127.9.61.67:39609)
0929 06:34:12.318104 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.318106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.318115 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:12.318142 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.318143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.318151 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.318223 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:12.318407 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.319018 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.320409 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.321023 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.321109 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.321120 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.321262 (+ 142us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.321299 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:34:12.321419 17474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.318025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:37183 (local address 127.9.61.65:39103)
0929 06:34:12.318122 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.318124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.318241 (+ 117us) server_negotiation.cc:407] Connection header received
0929 06:34:12.318324 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.318325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.318334 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.318407 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:12.318571 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.319310 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.320624 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.321037 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.321119 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.321130 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.321305 (+ 175us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.321346 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260929 06:34:12.321656 17402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12b2d81686914774b1e21ea4d5d33457" candidate_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" is_pre_election: true
I20260929 06:34:12.321789 17402 raft_consensus.cc:2454] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cfd4374f84d467a9cfefd2f85f236bd in term 0.
I20260929 06:34:12.321831 17505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.317900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:39103 (local address 127.9.61.66:37183)
0929 06:34:12.318162 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.318179 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.318263 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.318434 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.318435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.318436 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:12.318502 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.318503 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.319399 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.319400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.320543 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.320546 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.321157 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.321158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.321225 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.321229 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.321687 (+ 458us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.321726 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":148,"thread_start_us":62,"threads_started":1}
I20260929 06:34:12.322016 17196 leader_election.cc:302] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cfd4374f84d467a9cfefd2f85f236bd, 76c34496b6b24f39ae2dfcfd83c21b6e; no voters:
I20260929 06:34:12.322131 17484 raft_consensus.cc:2781] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:34:12.322166 17484 raft_consensus.cc:482] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:34:12.322120 17122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12b2d81686914774b1e21ea4d5d33457" candidate_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" is_pre_election: true
I20260929 06:34:12.322190 17484 raft_consensus.cc:3037] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.322199 17122 raft_consensus.cc:2454] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cfd4374f84d467a9cfefd2f85f236bd in term 0.
I20260929 06:34:12.322911 17484 raft_consensus.cc:504] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.323063 17484 leader_election.cc:288] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [CANDIDATE]: Term 1 election: Requested vote from peers 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103), 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67:39609)
I20260929 06:34:12.323240 17122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12b2d81686914774b1e21ea4d5d33457" candidate_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21f39941deab4dacaf77ed7abf4d4d5a"
I20260929 06:34:12.323320 17122 raft_consensus.cc:3037] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.323264 17402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12b2d81686914774b1e21ea4d5d33457" candidate_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e"
I20260929 06:34:12.323371 17402 raft_consensus.cc:3037] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.324057 17402 raft_consensus.cc:2454] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cfd4374f84d467a9cfefd2f85f236bd in term 1.
I20260929 06:34:12.324120 17122 raft_consensus.cc:2454] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cfd4374f84d467a9cfefd2f85f236bd in term 1.
I20260929 06:34:12.324240 17196 leader_election.cc:302] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cfd4374f84d467a9cfefd2f85f236bd, 76c34496b6b24f39ae2dfcfd83c21b6e; no voters:
I20260929 06:34:12.324393 17484 raft_consensus.cc:2781] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:12.324507 17484 raft_consensus.cc:686] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 LEADER]: Becoming Leader. State: Replica: 6cfd4374f84d467a9cfefd2f85f236bd, State: Running, Role: LEADER
I20260929 06:34:12.324581 17484 consensus_queue.cc:237] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.325309 16964 catalog_manager.cc:5495] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66). New cstate: current_term: 1 leader_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } health_report { overall_health: UNKNOWN } } }
Sep 29 06:34:12 dist-test-slave-601b krb5kdc[16920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663651, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.126@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:12.364614 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.356766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56908 (local address 127.9.61.126:44453)
0929 06:34:12.356818 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.356820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.356974 (+ 154us) server_negotiation.cc:407] Connection header received
0929 06:34:12.357051 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.357052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.357064 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.357132 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:12.357737 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.358237 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.359280 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.359461 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.359510 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.361863 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:12.361865 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:12.361865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:12.361871 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:12.363281 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.363681 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.363682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.363683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.363740 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.364027 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.364028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.364028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.364141 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:12.364220 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.364388 (+ 168us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.364502 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 06:34:12.364692 17513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.356653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:44453 (local address 127.0.0.1:56908)
0929 06:34:12.356868 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.356882 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.356976 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.357162 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.357163 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.357584 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:12.357645 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.357648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.358329 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.358331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.359183 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.359186 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.359539 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.359540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.359601 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.360227 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:12.360232 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:12.361756 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:12.363379 (+ 1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:12.363387 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:12.363389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:12.363588 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:12.363826 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:12.363827 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:12.363827 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:12.363883 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:12.364209 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:12.364217 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:12.364262 (+ 45us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.364362 (+ 100us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.364564 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":96,"thread_start_us":112,"threads_started":1}
W20260929 06:34:12.365634 17169 tablet.cc:2369] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:34:12.366621 16964 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:56908:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260929 06:34:12.366848 16964 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:34:12.368314 17102 tablet_service.cc:1467] Processing CreateTablet for tablet 736a6d42a67e441da4ebbc2af0095ccb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=11b518dce9744d888c4f41e4f1feac98]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:34:12.368316 17382 tablet_service.cc:1467] Processing CreateTablet for tablet 736a6d42a67e441da4ebbc2af0095ccb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=11b518dce9744d888c4f41e4f1feac98]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:34:12.368486 17102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 736a6d42a67e441da4ebbc2af0095ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.368487 17382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 736a6d42a67e441da4ebbc2af0095ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.370108 17477 tablet_bootstrap.cc:492] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a: Bootstrap starting.
I20260929 06:34:12.370223 17476 tablet_bootstrap.cc:492] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e: Bootstrap starting.
I20260929 06:34:12.370507 17477 tablet_bootstrap.cc:654] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.370635 17476 tablet_bootstrap.cc:654] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.371037 17242 tablet_service.cc:1467] Processing CreateTablet for tablet 736a6d42a67e441da4ebbc2af0095ccb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=11b518dce9744d888c4f41e4f1feac98]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260929 06:34:12.371183 17242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 736a6d42a67e441da4ebbc2af0095ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.371219 17477 tablet_bootstrap.cc:492] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a: No bootstrap required, opened a new log
I20260929 06:34:12.371273 17477 ts_tablet_manager.cc:1397] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:12.371424 17477 raft_consensus.cc:348] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.371505 17477 raft_consensus.cc:374] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.371532 17477 raft_consensus.cc:729] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21f39941deab4dacaf77ed7abf4d4d5a, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.371574 17477 consensus_queue.cc:260] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.371671 17477 ts_tablet_manager.cc:1428] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 06:34:12.371809 17483 tablet_replica.cc:439] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } }
I20260929 06:34:12.371893 17483 tablet_replica.cc:442] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:34:12.372776 17480 tablet_bootstrap.cc:492] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: Bootstrap starting.
I20260929 06:34:12.373211 17480 tablet_bootstrap.cc:654] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.373452 17476 tablet_bootstrap.cc:492] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e: No bootstrap required, opened a new log
I20260929 06:34:12.373502 17476 ts_tablet_manager.cc:1397] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260929 06:34:12.373663 17476 raft_consensus.cc:348] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.373725 17476 raft_consensus.cc:374] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.373750 17476 raft_consensus.cc:729] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76c34496b6b24f39ae2dfcfd83c21b6e, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.373785 17476 consensus_queue.cc:260] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.373888 17476 ts_tablet_manager.cc:1428] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:12.373912 17494 tablet_replica.cc:439] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } }
I20260929 06:34:12.373987 17494 tablet_replica.cc:442] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:34:12.374233 17480 tablet_bootstrap.cc:492] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: No bootstrap required, opened a new log
I20260929 06:34:12.374287 17480 ts_tablet_manager.cc:1397] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:34:12.374619 17480 raft_consensus.cc:348] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.374696 17480 raft_consensus.cc:374] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.374724 17480 raft_consensus.cc:729] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cfd4374f84d467a9cfefd2f85f236bd, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.374769 17480 consensus_queue.cc:260] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.374862 17480 ts_tablet_manager.cc:1428] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260929 06:34:12.374903 17484 tablet_replica.cc:439] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } }
I20260929 06:34:12.375013 17484 tablet_replica.cc:442] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: This TxnStatusTablet replica's current role is: FOLLOWER
W20260929 06:34:12.443591 17449 tablet.cc:2369] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:34:12.522418 17484 raft_consensus.cc:482] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:34:12.522513 17484 raft_consensus.cc:504] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.522711 17484 leader_election.cc:288] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103), 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67:39609)
I20260929 06:34:12.522991 17122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "736a6d42a67e441da4ebbc2af0095ccb" candidate_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" is_pre_election: true
I20260929 06:34:12.523015 17402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "736a6d42a67e441da4ebbc2af0095ccb" candidate_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" is_pre_election: true
I20260929 06:34:12.523109 17122 raft_consensus.cc:2454] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cfd4374f84d467a9cfefd2f85f236bd in term 0.
I20260929 06:34:12.523105 17402 raft_consensus.cc:2454] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cfd4374f84d467a9cfefd2f85f236bd in term 0.
I20260929 06:34:12.523286 17193 leader_election.cc:302] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21f39941deab4dacaf77ed7abf4d4d5a, 6cfd4374f84d467a9cfefd2f85f236bd; no voters:
I20260929 06:34:12.523407 17484 raft_consensus.cc:2781] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:34:12.523448 17484 raft_consensus.cc:482] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:34:12.523473 17484 raft_consensus.cc:3037] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.524130 17484 raft_consensus.cc:504] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.524264 17484 leader_election.cc:288] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [CANDIDATE]: Term 1 election: Requested vote from peers 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103), 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67:39609)
I20260929 06:34:12.524421 17122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "736a6d42a67e441da4ebbc2af0095ccb" candidate_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21f39941deab4dacaf77ed7abf4d4d5a"
I20260929 06:34:12.524497 17122 raft_consensus.cc:3037] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.524435 17402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "736a6d42a67e441da4ebbc2af0095ccb" candidate_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e"
I20260929 06:34:12.524528 17402 raft_consensus.cc:3037] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.525099 17122 raft_consensus.cc:2454] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cfd4374f84d467a9cfefd2f85f236bd in term 1.
I20260929 06:34:12.525179 17402 raft_consensus.cc:2454] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cfd4374f84d467a9cfefd2f85f236bd in term 1.
I20260929 06:34:12.525249 17193 leader_election.cc:302] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21f39941deab4dacaf77ed7abf4d4d5a, 6cfd4374f84d467a9cfefd2f85f236bd; no voters:
I20260929 06:34:12.525350 17484 raft_consensus.cc:2781] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:12.525468 17484 raft_consensus.cc:686] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 LEADER]: Becoming Leader. State: Replica: 6cfd4374f84d467a9cfefd2f85f236bd, State: Running, Role: LEADER
I20260929 06:34:12.525523 17484 consensus_queue.cc:237] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.525784 17506 tablet_replica.cc:439] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: TxnStatusTablet state changed. Reason: New leader 6cfd4374f84d467a9cfefd2f85f236bd. Latest consensus state: current_term: 1 leader_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } }
I20260929 06:34:12.525867 17506 tablet_replica.cc:442] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:34:12.526067 17518 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260929 06:34:12.526103 16964 catalog_manager.cc:5495] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66). New cstate: current_term: 1 leader_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260929 06:34:12.526218 17518 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260929 06:34:12.558075 17513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.555416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43801 (local address 127.0.0.1:38248)
0929 06:34:12.555499 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.555510 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.555562 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.555750 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.555752 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.555753 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:34:12.555804 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.555806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.556509 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.556511 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.557092 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.557093 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.557522 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.557523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.557589 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.557613 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:34:12.557892 (+ 279us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:34:12.557903 (+ 11us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.557954 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.558005 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260929 06:34:12.558055 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.555499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38248 (local address 127.9.61.66:43801)
0929 06:34:12.555551 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.555553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.555563 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:34:12.555643 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.555644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.555671 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.555747 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:34:12.555876 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.556423 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.557190 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.557457 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.557523 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.557707 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:34:12.557821 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:34:12.557905 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.557957 (+ 52us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.557979 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260929 06:34:12.559180 17122 raft_consensus.cc:1261] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Refusing update from remote peer 6cfd4374f84d467a9cfefd2f85f236bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:12.559233 17402 raft_consensus.cc:1261] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Refusing update from remote peer 6cfd4374f84d467a9cfefd2f85f236bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:12.559458 17484 consensus_queue.cc:1035] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:12.559576 17506 consensus_queue.cc:1035] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:12.560202 17483 tablet_replica.cc:439] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a: TxnStatusTablet state changed. Reason: New leader 6cfd4374f84d467a9cfefd2f85f236bd. Latest consensus state: current_term: 1 leader_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } }
I20260929 06:34:12.560299 17483 tablet_replica.cc:442] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:34:12.560400 17494 tablet_replica.cc:439] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e: TxnStatusTablet state changed. Reason: New leader 6cfd4374f84d467a9cfefd2f85f236bd. Latest consensus state: current_term: 1 leader_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } }
I20260929 06:34:12.560480 17494 tablet_replica.cc:442] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:34:12.561308 17506 tablet_replica.cc:439] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } }
I20260929 06:34:12.561396 17506 tablet_replica.cc:442] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:34:12.561439 17484 tablet_replica.cc:439] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } }
I20260929 06:34:12.561486 17484 tablet_replica.cc:442] T 736a6d42a67e441da4ebbc2af0095ccb P 6cfd4374f84d467a9cfefd2f85f236bd: This TxnStatusTablet replica's current role is: LEADER
I20260929 06:34:12.561450 17483 tablet_replica.cc:439] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } }
I20260929 06:34:12.561525 17483 tablet_replica.cc:442] T 736a6d42a67e441da4ebbc2af0095ccb P 21f39941deab4dacaf77ed7abf4d4d5a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:34:12.562327 17494 tablet_replica.cc:439] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } } }
I20260929 06:34:12.562412 17494 tablet_replica.cc:442] T 736a6d42a67e441da4ebbc2af0095ccb P 76c34496b6b24f39ae2dfcfd83c21b6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260929 06:34:12.565601 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.563140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38254 (local address 127.9.61.66:43801)
0929 06:34:12.563179 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.563180 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.563228 (+ 48us) server_negotiation.cc:407] Connection header received
0929 06:34:12.563290 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.563291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.563301 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.563352 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:34:12.563498 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.563922 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.565009 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.565181 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.565238 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.565399 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:34:12.565422 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:34:12.565461 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.565543 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.565557 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:34:12.570869 17526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.568008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43801 (local address 127.9.61.66:48011)
0929 06:34:12.568159 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.568168 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.568226 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.568341 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.568342 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.568343 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:34:12.568396 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.568397 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.569244 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.569245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.569923 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.569925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.570375 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.570376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.570440 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.570451 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:34:12.570707 (+ 256us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:34:12.570709 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.570762 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.570797 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":84,"threads_started":1}
I20260929 06:34:12.570917 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.568040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:48011 (local address 127.9.61.66:43801)
0929 06:34:12.568080 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.568082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.568246 (+ 164us) server_negotiation.cc:407] Connection header received
0929 06:34:12.568269 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.568270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.568280 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.568331 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:34:12.568449 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.569148 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.569997 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.570296 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.570368 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.570530 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:34:12.570562 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:34:12.570644 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.570780 (+ 136us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.570798 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:34:12.573117 17121 raft_consensus.cc:1261] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Refusing update from remote peer 6cfd4374f84d467a9cfefd2f85f236bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:12.573154 17402 raft_consensus.cc:1261] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Refusing update from remote peer 6cfd4374f84d467a9cfefd2f85f236bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:12.573382 17506 consensus_queue.cc:1035] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:12.573470 17484 consensus_queue.cc:1035] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:12.588400 16965 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53732:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:12.588519 16965 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53732:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:12.589140 16965 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1: Sending DeleteTablet for 3 replicas of tablet 12b2d81686914774b1e21ea4d5d33457
I20260929 06:34:12.589404 17102 tablet_service.cc:1514] Processing DeleteTablet for tablet 12b2d81686914774b1e21ea4d5d33457 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:12 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:53202
I20260929 06:34:12.589524 17242 tablet_service.cc:1514] Processing DeleteTablet for tablet 12b2d81686914774b1e21ea4d5d33457 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:12 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:38854
I20260929 06:34:12.589578 17382 tablet_service.cc:1514] Processing DeleteTablet for tablet 12b2d81686914774b1e21ea4d5d33457 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:12 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:36150
I20260929 06:34:12.589624 17499 tablet_replica.cc:330] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a: stopping tablet replica
I20260929 06:34:12.589643 17500 tablet_replica.cc:330] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd: stopping tablet replica
I20260929 06:34:12.589679 17499 raft_consensus.cc:2229] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:12.589702 17500 raft_consensus.cc:2229] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:34:12.589717 17499 raft_consensus.cc:2258] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:12.589780 17501 tablet_replica.cc:330] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e: stopping tablet replica
I20260929 06:34:12.589790 17500 raft_consensus.cc:2258] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:12.589843 17501 raft_consensus.cc:2229] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:12.589875 17501 raft_consensus.cc:2258] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:12.590145 17499 ts_tablet_manager.cc:1905] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:12.590333 17501 ts_tablet_manager.cc:1905] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:12.591684 17499 ts_tablet_manager.cc:1918] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:34:12.591763 17499 log.cc:1196] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/wal/wals/12b2d81686914774b1e21ea4d5d33457
I20260929 06:34:12.591986 17501 ts_tablet_manager.cc:1918] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:34:12.592047 17501 log.cc:1196] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/12b2d81686914774b1e21ea4d5d33457
I20260929 06:34:12.592042 17499 ts_tablet_manager.cc:1939] T 12b2d81686914774b1e21ea4d5d33457 P 21f39941deab4dacaf77ed7abf4d4d5a: Deleting consensus metadata
I20260929 06:34:12.592265 17501 ts_tablet_manager.cc:1939] T 12b2d81686914774b1e21ea4d5d33457 P 76c34496b6b24f39ae2dfcfd83c21b6e: Deleting consensus metadata
I20260929 06:34:12.592365 16949 catalog_manager.cc:4841] TS 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103): tablet 12b2d81686914774b1e21ea4d5d33457 (table test-table [id=f95e76418c9d4871a28ceacf92801a9c]) successfully deleted
I20260929 06:34:12.592598 17500 ts_tablet_manager.cc:1905] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:12.594105 17500 ts_tablet_manager.cc:1918] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:34:12.594165 17500 log.cc:1196] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/12b2d81686914774b1e21ea4d5d33457
I20260929 06:34:12.594359 17500 ts_tablet_manager.cc:1939] T 12b2d81686914774b1e21ea4d5d33457 P 6cfd4374f84d467a9cfefd2f85f236bd: Deleting consensus metadata
I20260929 06:34:12.594564 16952 catalog_manager.cc:4841] TS 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67:39609): tablet 12b2d81686914774b1e21ea4d5d33457 (table test-table [id=f95e76418c9d4871a28ceacf92801a9c]) successfully deleted
I20260929 06:34:12.594961 16950 catalog_manager.cc:4841] TS 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66:43801): tablet 12b2d81686914774b1e21ea4d5d33457 (table test-table [id=f95e76418c9d4871a28ceacf92801a9c]) successfully deleted
Sep 29 06:34:12 dist-test-slave-601b krb5kdc[16920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 29 06:34:12 dist-test-slave-601b krb5kdc[16920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:12 dist-test-slave-601b krb5kdc[16920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
W20260929 06:34:12.620342 17022 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:12.613979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56920 (local address 127.9.61.126:44453)
0929 06:34:12.614052 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.614054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.614162 (+ 108us) server_negotiation.cc:407] Connection header received
0929 06:34:12.614248 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.614250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.614258 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.614300 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:12.615032 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.615515 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.616788 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.616979 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.617037 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.620251 (+ 3214us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56920: BlockingRecv error: recv got EOF from 127.0.0.1:56920 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Sep 29 06:34:12 dist-test-slave-601b krb5kdc[16920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM
I20260929 06:34:12.628289 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.621390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56926 (local address 127.9.61.126:44453)
0929 06:34:12.621434 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.621443 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.621500 (+ 57us) server_negotiation.cc:407] Connection header received
0929 06:34:12.621572 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.621573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.621582 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.621634 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:12.622081 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.622562 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.623251 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.623447 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.623530 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.625706 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:12.625708 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:12.625708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:12.625715 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:12.627159 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.627505 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.627506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.627506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.627567 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:12.627776 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:12.627776 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:12.627777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:12.627890 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:12.628018 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.628116 (+ 98us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.628188 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:34:12.629899 16965 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:34:12.630077 16965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:34:12.631418 17102 tablet_service.cc:1467] Processing CreateTablet for tablet bb37dc1c835d42169b3c35b1349d8cd8 (DEFAULT_TABLE table=test-table [id=7c21635ab8524321a4d260f220249bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:12.631464 17242 tablet_service.cc:1467] Processing CreateTablet for tablet bb37dc1c835d42169b3c35b1349d8cd8 (DEFAULT_TABLE table=test-table [id=7c21635ab8524321a4d260f220249bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:12.631474 17382 tablet_service.cc:1467] Processing CreateTablet for tablet bb37dc1c835d42169b3c35b1349d8cd8 (DEFAULT_TABLE table=test-table [id=7c21635ab8524321a4d260f220249bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:12.631557 17102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb37dc1c835d42169b3c35b1349d8cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.631574 17382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb37dc1c835d42169b3c35b1349d8cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.631585 17242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb37dc1c835d42169b3c35b1349d8cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.632902 17477 tablet_bootstrap.cc:492] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a: Bootstrap starting.
I20260929 06:34:12.632902 17476 tablet_bootstrap.cc:492] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e: Bootstrap starting.
I20260929 06:34:12.632978 17480 tablet_bootstrap.cc:492] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd: Bootstrap starting.
I20260929 06:34:12.633231 17476 tablet_bootstrap.cc:654] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.633282 17477 tablet_bootstrap.cc:654] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.633376 17480 tablet_bootstrap.cc:654] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.634104 17477 tablet_bootstrap.cc:492] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a: No bootstrap required, opened a new log
I20260929 06:34:12.634122 17476 tablet_bootstrap.cc:492] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e: No bootstrap required, opened a new log
I20260929 06:34:12.634157 17477 ts_tablet_manager.cc:1397] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:12.634167 17476 ts_tablet_manager.cc:1397] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:12.634297 17476 raft_consensus.cc:348] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.634313 17477 raft_consensus.cc:348] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.634374 17476 raft_consensus.cc:374] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.634397 17476 raft_consensus.cc:729] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76c34496b6b24f39ae2dfcfd83c21b6e, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.634393 17477 raft_consensus.cc:374] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.634419 17477 raft_consensus.cc:729] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21f39941deab4dacaf77ed7abf4d4d5a, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.634439 17476 consensus_queue.cc:260] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.634466 17477 consensus_queue.cc:260] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.634523 17476 ts_tablet_manager.cc:1428] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:12.634548 17477 ts_tablet_manager.cc:1428] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 06:34:12.635109 17480 tablet_bootstrap.cc:492] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd: No bootstrap required, opened a new log
I20260929 06:34:12.635169 17480 ts_tablet_manager.cc:1397] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:34:12.635275 17480 raft_consensus.cc:348] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.635342 17480 raft_consensus.cc:374] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.635361 17480 raft_consensus.cc:729] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cfd4374f84d467a9cfefd2f85f236bd, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.635402 17480 consensus_queue.cc:260] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.635495 17480 ts_tablet_manager.cc:1428] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:12.752156 17494 raft_consensus.cc:482] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:34:12.752276 17494 raft_consensus.cc:504] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.752460 17494 leader_election.cc:288] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103), 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66:43801)
I20260929 06:34:12.752674 17122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb37dc1c835d42169b3c35b1349d8cd8" candidate_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" is_pre_election: true
I20260929 06:34:12.752697 17262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb37dc1c835d42169b3c35b1349d8cd8" candidate_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" is_pre_election: true
I20260929 06:34:12.752792 17262 raft_consensus.cc:2454] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76c34496b6b24f39ae2dfcfd83c21b6e in term 0.
I20260929 06:34:12.752795 17122 raft_consensus.cc:2454] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76c34496b6b24f39ae2dfcfd83c21b6e in term 0.
I20260929 06:34:12.752991 17333 leader_election.cc:302] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21f39941deab4dacaf77ed7abf4d4d5a, 76c34496b6b24f39ae2dfcfd83c21b6e; no voters:
I20260929 06:34:12.753091 17494 raft_consensus.cc:2781] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:34:12.753125 17494 raft_consensus.cc:482] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:34:12.753144 17494 raft_consensus.cc:3037] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.754120 17494 raft_consensus.cc:504] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.754268 17494 leader_election.cc:288] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [CANDIDATE]: Term 1 election: Requested vote from peers 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103), 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66:43801)
I20260929 06:34:12.754457 17122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb37dc1c835d42169b3c35b1349d8cd8" candidate_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21f39941deab4dacaf77ed7abf4d4d5a"
I20260929 06:34:12.754477 17262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb37dc1c835d42169b3c35b1349d8cd8" candidate_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cfd4374f84d467a9cfefd2f85f236bd"
I20260929 06:34:12.754545 17122 raft_consensus.cc:3037] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.754565 17262 raft_consensus.cc:3037] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.755203 17262 raft_consensus.cc:2454] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76c34496b6b24f39ae2dfcfd83c21b6e in term 1.
I20260929 06:34:12.755307 17122 raft_consensus.cc:2454] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76c34496b6b24f39ae2dfcfd83c21b6e in term 1.
I20260929 06:34:12.755401 17334 leader_election.cc:302] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cfd4374f84d467a9cfefd2f85f236bd, 76c34496b6b24f39ae2dfcfd83c21b6e; no voters:
I20260929 06:34:12.755512 17494 raft_consensus.cc:2781] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:12.755578 17494 raft_consensus.cc:686] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 LEADER]: Becoming Leader. State: Replica: 76c34496b6b24f39ae2dfcfd83c21b6e, State: Running, Role: LEADER
I20260929 06:34:12.755650 17494 consensus_queue.cc:237] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.756297 16965 catalog_manager.cc:5495] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67). New cstate: current_term: 1 leader_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } health_report { overall_health: HEALTHY } } }
I20260929 06:34:12.781057 17473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.778623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47064 (local address 127.9.61.67:39609)
0929 06:34:12.778715 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.778718 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.778728 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:34:12.778778 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.778779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.778798 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.778917 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:34:12.779039 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.779511 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.780372 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.780563 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.780638 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.780796 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:34:12.780824 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:34:12.780882 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.780949 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.780969 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260929 06:34:12.781945 17262 raft_consensus.cc:1261] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Refusing update from remote peer 76c34496b6b24f39ae2dfcfd83c21b6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:12.782023 17122 raft_consensus.cc:1261] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Refusing update from remote peer 76c34496b6b24f39ae2dfcfd83c21b6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:12.782246 17494 consensus_queue.cc:1035] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:12.782349 17482 consensus_queue.cc:1035] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:12.784910 16965 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:12.785001 16965 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:12.785480 16965 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1: Sending DeleteTablet for 3 replicas of tablet bb37dc1c835d42169b3c35b1349d8cd8
I20260929 06:34:12.785709 17102 tablet_service.cc:1514] Processing DeleteTablet for tablet bb37dc1c835d42169b3c35b1349d8cd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:12 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:53202
I20260929 06:34:12.785725 17382 tablet_service.cc:1514] Processing DeleteTablet for tablet bb37dc1c835d42169b3c35b1349d8cd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:12 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:36150
I20260929 06:34:12.785811 17242 tablet_service.cc:1514] Processing DeleteTablet for tablet bb37dc1c835d42169b3c35b1349d8cd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:12 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:38854
I20260929 06:34:12.785830 17499 tablet_replica.cc:330] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a: stopping tablet replica
I20260929 06:34:12.785840 17501 tablet_replica.cc:330] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e: stopping tablet replica
I20260929 06:34:12.785888 17499 raft_consensus.cc:2229] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:12.785892 17500 tablet_replica.cc:330] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd: stopping tablet replica
I20260929 06:34:12.785897 17501 raft_consensus.cc:2229] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:34:12.785935 17499 raft_consensus.cc:2258] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:12.785933 17500 raft_consensus.cc:2229] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:12.785959 17501 raft_consensus.cc:2258] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:12.785966 17500 raft_consensus.cc:2258] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:12.786314 17501 ts_tablet_manager.cc:1905] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:12.786404 17499 ts_tablet_manager.cc:1905] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:12.786405 17500 ts_tablet_manager.cc:1905] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:12.787487 16965 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:34:12.787631 16965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:34:12.787669 17501 ts_tablet_manager.cc:1918] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:12.787714 17501 log.cc:1196] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/bb37dc1c835d42169b3c35b1349d8cd8
I20260929 06:34:12.787807 17499 ts_tablet_manager.cc:1918] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:12.787799 17500 ts_tablet_manager.cc:1918] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:12.787873 17499 log.cc:1196] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-0/wal/wals/bb37dc1c835d42169b3c35b1349d8cd8
I20260929 06:34:12.787875 17500 log.cc:1196] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/bb37dc1c835d42169b3c35b1349d8cd8
I20260929 06:34:12.787988 17501 ts_tablet_manager.cc:1939] T bb37dc1c835d42169b3c35b1349d8cd8 P 76c34496b6b24f39ae2dfcfd83c21b6e: Deleting consensus metadata
I20260929 06:34:12.788127 17500 ts_tablet_manager.cc:1939] T bb37dc1c835d42169b3c35b1349d8cd8 P 6cfd4374f84d467a9cfefd2f85f236bd: Deleting consensus metadata
I20260929 06:34:12.788127 17499 ts_tablet_manager.cc:1939] T bb37dc1c835d42169b3c35b1349d8cd8 P 21f39941deab4dacaf77ed7abf4d4d5a: Deleting consensus metadata
I20260929 06:34:12.788520 16952 catalog_manager.cc:4841] TS 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67:39609): tablet bb37dc1c835d42169b3c35b1349d8cd8 (table test-table [id=7c21635ab8524321a4d260f220249bb0]) successfully deleted
I20260929 06:34:12.788590 16949 catalog_manager.cc:4841] TS 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103): tablet bb37dc1c835d42169b3c35b1349d8cd8 (table test-table [id=7c21635ab8524321a4d260f220249bb0]) successfully deleted
I20260929 06:34:12.788640 16950 catalog_manager.cc:4841] TS 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66:43801): tablet bb37dc1c835d42169b3c35b1349d8cd8 (table test-table [id=7c21635ab8524321a4d260f220249bb0]) successfully deleted
I20260929 06:34:12.788913 17102 tablet_service.cc:1467] Processing CreateTablet for tablet d45358a0de8d42ab85302af454b50baa (DEFAULT_TABLE table=test-table [id=88b80c06dca84842ba2d78a8939dd8f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:12.788954 17242 tablet_service.cc:1467] Processing CreateTablet for tablet d45358a0de8d42ab85302af454b50baa (DEFAULT_TABLE table=test-table [id=88b80c06dca84842ba2d78a8939dd8f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:12.789034 17242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d45358a0de8d42ab85302af454b50baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.789034 17102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d45358a0de8d42ab85302af454b50baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.790252 17480 tablet_bootstrap.cc:492] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd: Bootstrap starting.
I20260929 06:34:12.790338 17382 tablet_service.cc:1467] Processing CreateTablet for tablet d45358a0de8d42ab85302af454b50baa (DEFAULT_TABLE table=test-table [id=88b80c06dca84842ba2d78a8939dd8f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:12.790443 17382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d45358a0de8d42ab85302af454b50baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:12.790596 17480 tablet_bootstrap.cc:654] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.790848 17477 tablet_bootstrap.cc:492] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a: Bootstrap starting.
I20260929 06:34:12.791196 17480 tablet_bootstrap.cc:492] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd: No bootstrap required, opened a new log
I20260929 06:34:12.791249 17480 ts_tablet_manager.cc:1397] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:12.791350 17480 raft_consensus.cc:348] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.791425 17480 raft_consensus.cc:374] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.791450 17480 raft_consensus.cc:729] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cfd4374f84d467a9cfefd2f85f236bd, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.791486 17477 tablet_bootstrap.cc:654] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.791498 17480 consensus_queue.cc:260] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.791509 17476 tablet_bootstrap.cc:492] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e: Bootstrap starting.
I20260929 06:34:12.791592 17480 ts_tablet_manager.cc:1428] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:12.791857 17476 tablet_bootstrap.cc:654] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:12.792243 17477 tablet_bootstrap.cc:492] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a: No bootstrap required, opened a new log
I20260929 06:34:12.792299 17477 ts_tablet_manager.cc:1397] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:12.792443 17477 raft_consensus.cc:348] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.792508 17477 raft_consensus.cc:374] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.792527 17477 raft_consensus.cc:729] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21f39941deab4dacaf77ed7abf4d4d5a, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.792537 17476 tablet_bootstrap.cc:492] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e: No bootstrap required, opened a new log
I20260929 06:34:12.792586 17476 ts_tablet_manager.cc:1397] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:12.792590 17477 consensus_queue.cc:260] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.792693 17477 ts_tablet_manager.cc:1428] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 06:34:12.792689 17476 raft_consensus.cc:348] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.792754 17476 raft_consensus.cc:374] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:12.792780 17476 raft_consensus.cc:729] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76c34496b6b24f39ae2dfcfd83c21b6e, State: Initialized, Role: FOLLOWER
I20260929 06:34:12.792822 17476 consensus_queue.cc:260] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.792913 17476 ts_tablet_manager.cc:1428] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:12.933178 17483 raft_consensus.cc:482] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:34:12.933287 17483 raft_consensus.cc:504] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.933678 17483 leader_election.cc:288] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66:43801), 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67:39609)
I20260929 06:34:12.937081 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.933999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:40319 (local address 127.9.61.66:43801)
0929 06:34:12.934056 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.934059 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.934200 (+ 141us) server_negotiation.cc:407] Connection header received
0929 06:34:12.934256 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.934256 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.934285 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.934349 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:12.934570 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.935094 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.936333 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.936707 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.936808 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.936821 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.936957 (+ 136us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.936999 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:34:12.937098 17473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.934011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:42867 (local address 127.9.61.67:39609)
0929 06:34:12.934064 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.934066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.934140 (+ 74us) server_negotiation.cc:407] Connection header received
0929 06:34:12.934219 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.934220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.934231 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.934296 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:12.934460 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.934968 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.936297 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.936682 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.936740 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.936750 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.936980 (+ 230us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.937030 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 06:34:12.937115 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.933915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:39609 (local address 127.9.61.65:42867)
0929 06:34:12.934051 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.934063 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.934135 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.934314 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.934315 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.934318 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:12.934382 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.934384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.935103 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.935105 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.936212 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.936214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.936792 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.936793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.936887 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.936890 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.936961 (+ 71us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.937004 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":1,"thread_start_us":74,"threads_started":1}
I20260929 06:34:12.937115 17552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.933915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43801 (local address 127.9.61.65:40319)
0929 06:34:12.934092 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.934103 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.934194 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.934373 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.934374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.934378 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:12.934466 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.934467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.935187 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.935187 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.936224 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.936226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.936831 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.936832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.936883 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.936886 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.936929 (+ 43us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.936996 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":6,"spinlock_wait_cycles":1408,"thread_start_us":70,"threads_started":1}
I20260929 06:34:12.937391 17402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d45358a0de8d42ab85302af454b50baa" candidate_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" is_pre_election: true
I20260929 06:34:12.937490 17402 raft_consensus.cc:2454] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21f39941deab4dacaf77ed7abf4d4d5a in term 0.
I20260929 06:34:12.937659 17262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d45358a0de8d42ab85302af454b50baa" candidate_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" is_pre_election: true
I20260929 06:34:12.937682 17056 leader_election.cc:302] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21f39941deab4dacaf77ed7abf4d4d5a, 76c34496b6b24f39ae2dfcfd83c21b6e; no voters:
I20260929 06:34:12.937752 17262 raft_consensus.cc:2454] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21f39941deab4dacaf77ed7abf4d4d5a in term 0.
I20260929 06:34:12.937812 17483 raft_consensus.cc:2781] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:34:12.937860 17483 raft_consensus.cc:482] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:34:12.937875 17483 raft_consensus.cc:3037] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.938601 17483 raft_consensus.cc:504] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.938716 17483 leader_election.cc:288] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [CANDIDATE]: Term 1 election: Requested vote from peers 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66:43801), 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67:39609)
I20260929 06:34:12.938871 17262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d45358a0de8d42ab85302af454b50baa" candidate_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cfd4374f84d467a9cfefd2f85f236bd"
I20260929 06:34:12.938872 17402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d45358a0de8d42ab85302af454b50baa" candidate_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e"
I20260929 06:34:12.938954 17262 raft_consensus.cc:3037] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.939003 17402 raft_consensus.cc:3037] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:12.939736 17262 raft_consensus.cc:2454] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21f39941deab4dacaf77ed7abf4d4d5a in term 1.
I20260929 06:34:12.939736 17402 raft_consensus.cc:2454] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21f39941deab4dacaf77ed7abf4d4d5a in term 1.
I20260929 06:34:12.939978 17054 leader_election.cc:302] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21f39941deab4dacaf77ed7abf4d4d5a, 6cfd4374f84d467a9cfefd2f85f236bd; no voters:
I20260929 06:34:12.940091 17483 raft_consensus.cc:2781] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:12.940241 17483 raft_consensus.cc:686] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 LEADER]: Becoming Leader. State: Replica: 21f39941deab4dacaf77ed7abf4d4d5a, State: Running, Role: LEADER
I20260929 06:34:12.940358 17483 consensus_queue.cc:237] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } }
I20260929 06:34:12.941113 16964 catalog_manager.cc:5495] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a reported cstate change: term changed from 0 to 1, leader changed from <none> to 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65). New cstate: current_term: 1 leader_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21f39941deab4dacaf77ed7abf4d4d5a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260929 06:34:12.978466 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.976009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57840 (local address 127.9.61.65:39103)
0929 06:34:12.976187 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.976188 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.976196 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:34:12.976235 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.976235 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.976256 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.976341 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:34:12.976454 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.977009 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.977734 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.977980 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.978049 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.978173 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:34:12.978284 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:34:12.978345 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.978376 (+ 31us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.978393 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":112,"threads_started":1}
I20260929 06:34:12.983734 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.981085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:34633 (local address 127.9.61.66:43801)
0929 06:34:12.981259 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.981262 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.981354 (+ 92us) server_negotiation.cc:407] Connection header received
0929 06:34:12.981424 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.981425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.981436 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.981516 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:34:12.981676 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.982177 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.982991 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.983193 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.983282 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.983478 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:34:12.983518 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:34:12.983581 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.983635 (+ 54us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.983655 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260929 06:34:12.983762 17559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.980977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43801 (local address 127.9.61.65:34633)
0929 06:34:12.981268 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.981279 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.981371 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.981521 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.981522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.981524 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:34:12.981589 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.981591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.982257 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.982258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.982893 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.982895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.983300 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.983302 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.983377 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.983391 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:34:12.983582 (+ 191us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:34:12.983584 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.983632 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.983680 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":92,"threads_started":1}
I20260929 06:34:12.986053 17262 raft_consensus.cc:1261] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Refusing update from remote peer 21f39941deab4dacaf77ed7abf4d4d5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:12.986083 17402 raft_consensus.cc:1261] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Refusing update from remote peer 21f39941deab4dacaf77ed7abf4d4d5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:12.986336 17483 consensus_queue.cc:1035] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "76c34496b6b24f39ae2dfcfd83c21b6e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:12.986526 17554 consensus_queue.cc:1035] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cfd4374f84d467a9cfefd2f85f236bd" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:12.993607 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.991283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:44893 (local address 127.9.61.65:39103)
0929 06:34:12.991322 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:12.991324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:12.991333 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:12.991406 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:12.991407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:12.991417 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:12.991470 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:34:12.991574 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.992149 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.992850 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.993145 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.993218 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.993369 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:34:12.993403 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:34:12.993456 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:12.993505 (+ 49us) server_negotiation.cc:299] Negotiation successful
0929 06:34:12.993530 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:34:12.993631 17526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:12.991236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:39103 (local address 127.9.61.66:44893)
0929 06:34:12.991282 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:12.991293 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:12.991330 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:12.991473 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:12.991474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:12.991475 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0929 06:34:12.991523 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.991524 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.992212 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.992213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.992762 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:12.992764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:12.993225 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:12.993226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:12.993289 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:12.993296 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0929 06:34:12.993455 (+ 159us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0929 06:34:12.993457 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:34:12.993503 (+ 46us) client_negotiation.cc:240] Negotiation successful
0929 06:34:12.993548 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260929 06:34:13.001055 16964 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:13.001181 16964 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:13.001897 16964 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cd2f2061d3484ec384e3fe535d15a5a1: Sending DeleteTablet for 3 replicas of tablet d45358a0de8d42ab85302af454b50baa
I20260929 06:34:13.002134 17242 tablet_service.cc:1514] Processing DeleteTablet for tablet d45358a0de8d42ab85302af454b50baa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:12 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:38854
I20260929 06:34:13.002134 17102 tablet_service.cc:1514] Processing DeleteTablet for tablet d45358a0de8d42ab85302af454b50baa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:12 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:53202
I20260929 06:34:13.002241 17500 tablet_replica.cc:330] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd: stopping tablet replica
I20260929 06:34:13.002247 17382 tablet_service.cc:1514] Processing DeleteTablet for tablet d45358a0de8d42ab85302af454b50baa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:12 UTC) from {username='oryx', principal='oryx/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:36150
I20260929 06:34:13.002301 17500 raft_consensus.cc:2229] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:13.002341 17499 tablet_replica.cc:330] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a: stopping tablet replica
I20260929 06:34:13.002350 17500 raft_consensus.cc:2258] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:13.002396 17499 raft_consensus.cc:2229] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:34:13.002429 17501 tablet_replica.cc:330] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e: stopping tablet replica
I20260929 06:34:13.002482 17501 raft_consensus.cc:2229] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:13.002496 17499 raft_consensus.cc:2258] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:13.002528 17501 raft_consensus.cc:2258] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:13.002977 17499 ts_tablet_manager.cc:1905] T d45358a0de8d42ab85302af454b50baa P 21f39941deab4dacaf77ed7abf4d4d5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:13.002972 17500 ts_tablet_manager.cc:1905] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:13.003190 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 17037
I20260929 06:34:13.004612 17501 ts_tablet_manager.cc:1905] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:13.004695 17500 ts_tablet_manager.cc:1918] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:34:13.004739 17500 log.cc:1196] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/d45358a0de8d42ab85302af454b50baa
I20260929 06:34:13.004897 17500 ts_tablet_manager.cc:1939] T d45358a0de8d42ab85302af454b50baa P 6cfd4374f84d467a9cfefd2f85f236bd: Deleting consensus metadata
I20260929 06:34:13.005182 16950 catalog_manager.cc:4841] TS 6cfd4374f84d467a9cfefd2f85f236bd (127.9.61.66:43801): tablet d45358a0de8d42ab85302af454b50baa (table test-table [id=88b80c06dca84842ba2d78a8939dd8f8]) successfully deleted
I20260929 06:34:13.006450 17501 ts_tablet_manager.cc:1918] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260929 06:34:13.006506 17501 log.cc:1196] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/d45358a0de8d42ab85302af454b50baa
I20260929 06:34:13.006726 17501 ts_tablet_manager.cc:1939] T d45358a0de8d42ab85302af454b50baa P 76c34496b6b24f39ae2dfcfd83c21b6e: Deleting consensus metadata
I20260929 06:34:13.007107 16952 catalog_manager.cc:4841] TS 76c34496b6b24f39ae2dfcfd83c21b6e (127.9.61.67:39609): tablet d45358a0de8d42ab85302af454b50baa (table test-table [id=88b80c06dca84842ba2d78a8939dd8f8]) successfully deleted
W20260929 06:34:13.011224 16949 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:39103 (error 108)
I20260929 06:34:13.011433 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 17177
I20260929 06:34:13.012538 17565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:13.012281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:39103 (local address 127.0.0.1:57848)
0929 06:34:13.012441 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:13.012487 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:39103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":42,"threads_started":1}
W20260929 06:34:13.012691 16949 catalog_manager.cc:4584] TS 21f39941deab4dacaf77ed7abf4d4d5a (127.9.61.65:39103): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d45358a0de8d42ab85302af454b50baa: Network error: Client connection negotiation failed: client connection to 127.9.61.65:39103: connect: Connection refused (error 111)
I20260929 06:34:13.018311 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 17317
I20260929 06:34:13.024503 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 16933
2026-09-29T06:34:13Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2663 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:34:13 dist-test-slave-601b krb5kdc[17568](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:34:13 dist-test-slave-601b krb5kdc[17568](info): set up 2 sockets
Sep 29 06:34:13 dist-test-slave-601b krb5kdc[17568](info): commencing operation
krb5kdc: starting...
W20260929 06:34:14.068477 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:34:14 dist-test-slave-601b krb5kdc[17568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:34:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:34:14.186605 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:39687
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:44743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:39687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:14.266276 17581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:14.266475 17581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:14.266496 17581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:14.267573 17581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:14.267608 17581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:14.267622 17581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:14.267634 17581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:14.267647 17581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:14.269158 17581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:44743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:39687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:39687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:14.269359 17581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:14.269519 17581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:14.274230 17589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:14.274240 17587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:14.274307 17581 server_base.cc:1034] running on GCE node
W20260929 06:34:14.274230 17586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:14.274757 17581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:14.275084 17581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:14.276226 17581 hybrid_clock.cc:648] HybridClock initialized: now 1790663654276209 us; error 40 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-29T06:34:14Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1259 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:34:14 dist-test-slave-601b krb5kdc[17594](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:34:14 dist-test-slave-601b krb5kdc[17594](info): set up 2 sockets
Sep 29 06:34:14 dist-test-slave-601b krb5kdc[17594](info): commencing operation
krb5kdc: starting...
W20260929 06:34:15.316506 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:34:15 dist-test-slave-601b krb5kdc[17594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:34:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:34:15.434406 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:42315
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:42315
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:15.514689 17607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:15.514943 17607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:15.514983 17607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:15.516152 17607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:15.516218 17607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:15.516242 17607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:15.516263 17607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:15.516304 17607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:15.517714 17607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:42315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:42315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:15.517977 17607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:15.518186 17607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:15.522918 17615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:15.522924 17612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:15.522949 17613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:15.523130 17607 server_base.cc:1034] running on GCE node
I20260929 06:34:15.523371 17607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:15.523646 17607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:15.524807 17607 hybrid_clock.cc:648] HybridClock initialized: now 1790663655524792 us; error 46 us; skew 500 ppm
Sep 29 06:34:15 dist-test-slave-601b krb5kdc[17594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663655, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:15.527192 17607 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:34:15.527631 17607 webserver.cc:460] Webserver started at http://127.9.61.126:33785/ using document root <none> and password file <none>
I20260929 06:34:15.527807 17607 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:15.527855 17607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:15.528016 17607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:15.529007 17607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "31d550e7411149aaae12e3bcea40aa06"
format_stamp: "Formatted at 2026-09-29 06:34:15 on dist-test-slave-601b"
server_key: "ff82bc1f0a2429789d39ed2360fd3c21"
server_key_iv: "0a6dffdea084ceb42a6c1f0f2f661da3"
server_key_version: "encryptionkey@0"
I20260929 06:34:15.529299 17607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "31d550e7411149aaae12e3bcea40aa06"
format_stamp: "Formatted at 2026-09-29 06:34:15 on dist-test-slave-601b"
server_key: "ff82bc1f0a2429789d39ed2360fd3c21"
server_key_iv: "0a6dffdea084ceb42a6c1f0f2f661da3"
server_key_version: "encryptionkey@0"
I20260929 06:34:15.530550 17607 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:34:15.531213 17622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:15.531412 17607 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:34:15.531505 17607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "31d550e7411149aaae12e3bcea40aa06"
format_stamp: "Formatted at 2026-09-29 06:34:15 on dist-test-slave-601b"
server_key: "ff82bc1f0a2429789d39ed2360fd3c21"
server_key_iv: "0a6dffdea084ceb42a6c1f0f2f661da3"
server_key_version: "encryptionkey@0"
I20260929 06:34:15.531579 17607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:15.543572 17607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:15.545378 17607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:15.545526 17607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:15.549638 17607 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:42315
I20260929 06:34:15.549669 17674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:42315 every 8 connection(s)
I20260929 06:34:15.550019 17607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:15.550877 17675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:15.553179 17675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06: Bootstrap starting.
I20260929 06:34:15.553686 17675 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:15.553925 17675 log.cc:824] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:15.554515 17675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06: No bootstrap required, opened a new log
I20260929 06:34:15.556042 17675 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d550e7411149aaae12e3bcea40aa06" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 42315 } }
I20260929 06:34:15.556171 17675 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:15.556195 17675 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d550e7411149aaae12e3bcea40aa06, State: Initialized, Role: FOLLOWER
I20260929 06:34:15.556290 17675 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d550e7411149aaae12e3bcea40aa06" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 42315 } }
I20260929 06:34:15.556375 17675 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:15.556412 17675 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:15.556465 17675 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:15.556957 17675 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d550e7411149aaae12e3bcea40aa06" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 42315 } }
I20260929 06:34:15.557077 17675 leader_election.cc:302] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31d550e7411149aaae12e3bcea40aa06; no voters:
I20260929 06:34:15.557250 17675 leader_election.cc:288] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:15.557302 17678 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:15.557495 17675 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:15.557734 17678 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 1 LEADER]: Becoming Leader. State: Replica: 31d550e7411149aaae12e3bcea40aa06, State: Running, Role: LEADER
I20260929 06:34:15.558586 17678 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d550e7411149aaae12e3bcea40aa06" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 42315 } }
I20260929 06:34:15.558945 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 17607
I20260929 06:34:15.559067 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:15.559140 17680 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31d550e7411149aaae12e3bcea40aa06. Latest consensus state: current_term: 1 leader_uuid: "31d550e7411149aaae12e3bcea40aa06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d550e7411149aaae12e3bcea40aa06" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 42315 } } }
I20260929 06:34:15.559217 17680 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:15.559306 9461 external_mini_cluster.cc:1428] Setting key d5a89635200e0352b713c7094ad7160b
I20260929 06:34:15.559512 17693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:15.559548 17679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31d550e7411149aaae12e3bcea40aa06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d550e7411149aaae12e3bcea40aa06" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 42315 } } }
I20260929 06:34:15.559782 17679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:15.560351 17693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:15.561734 17693 catalog_manager.cc:1347] Generated new cluster ID: 6d6c7834eab54424b66a05bd1db3cf42
I20260929 06:34:15.561784 17693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:34:15 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:15.570937 17696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:15.559865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54886 (local address 127.9.61.126:42315)
0929 06:34:15.560052 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:15.560061 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:15.560099 (+ 38us) server_negotiation.cc:407] Connection header received
0929 06:34:15.560215 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:15.560222 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:15.560279 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:15.560457 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:15.561230 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:15.562599 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:15.563706 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:15.564304 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:15.564406 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:15.567164 (+ 2758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:15.567169 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:15.567169 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:15.567185 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:15.569301 (+ 2116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:15.569690 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:15.569693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:15.569693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:15.569803 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:15.570015 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:15.570016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:15.570016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:15.570322 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:15.570471 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:15.570569 (+ 98us) server_negotiation.cc:299] Negotiation successful
0929 06:34:15.570709 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":107,"threads_started":1}
I20260929 06:34:15.578423 17693 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:15.579071 17693 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:15.584511 17693 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06: Generated new TSK 0
I20260929 06:34:15.584687 17693 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:34:15.610740 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:42315
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:15.691370 17701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:15.691568 17701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:15.691591 17701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:15.692710 17701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:15.692746 17701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:15.692772 17701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:34:15.694068 17701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:42315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:15.694235 17701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:15.694397 17701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:15.699205 17706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:15.699234 17707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:15.699205 17709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:15.699517 17701 server_base.cc:1034] running on GCE node
I20260929 06:34:15.699710 17701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:15.699895 17701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:15.701077 17701 hybrid_clock.cc:648] HybridClock initialized: now 1790663655701062 us; error 31 us; skew 500 ppm
Sep 29 06:34:15 dist-test-slave-601b krb5kdc[17594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663655, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:15.703616 17701 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:34:15.704090 17701 webserver.cc:460] Webserver started at http://127.9.61.65:40417/ using document root <none> and password file <none>
I20260929 06:34:15.704311 17701 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:15.704385 17701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:15.704537 17701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:15.705571 17701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "460e690e431f4288a7c52bb10ef33d28"
format_stamp: "Formatted at 2026-09-29 06:34:15 on dist-test-slave-601b"
server_key: "f5177049bc68fa9911418da6d7e95bbe"
server_key_iv: "4e75a514e94393d6cd8f0c8e407bdfb6"
server_key_version: "encryptionkey@0"
I20260929 06:34:15.705936 17701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "460e690e431f4288a7c52bb10ef33d28"
format_stamp: "Formatted at 2026-09-29 06:34:15 on dist-test-slave-601b"
server_key: "f5177049bc68fa9911418da6d7e95bbe"
server_key_iv: "4e75a514e94393d6cd8f0c8e407bdfb6"
server_key_version: "encryptionkey@0"
I20260929 06:34:15.707233 17701 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:34:15.707918 17716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:15.708108 17701 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:15.708206 17701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "460e690e431f4288a7c52bb10ef33d28"
format_stamp: "Formatted at 2026-09-29 06:34:15 on dist-test-slave-601b"
server_key: "f5177049bc68fa9911418da6d7e95bbe"
server_key_iv: "4e75a514e94393d6cd8f0c8e407bdfb6"
server_key_version: "encryptionkey@0"
I20260929 06:34:15.708292 17701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:15.726990 17701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:15.729001 17701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:15.729168 17701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:15.729409 17701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:15.729712 17701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:15.729764 17701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:15.729807 17701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:15.729831 17701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:15.735771 17701 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:35735
I20260929 06:34:15.735827 17829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:35735 every 8 connection(s)
I20260929 06:34:15.736186 17701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:34:15 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663655, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:15.744684 17696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:15.736929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:57667 (local address 127.9.61.126:42315)
0929 06:34:15.736980 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:15.736984 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:15.737205 (+ 221us) server_negotiation.cc:407] Connection header received
0929 06:34:15.737667 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:15.737668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:15.737681 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:15.737733 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:15.738622 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:15.739126 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:15.740143 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:15.740328 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:15.740379 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:15.742338 (+ 1959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:15.742339 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:15.742340 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:15.742348 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:15.743568 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:15.743915 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:15.743915 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:15.743916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:15.743983 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:15.744183 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:15.744183 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:15.744184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:15.744279 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:15.744328 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:15.744562 (+ 234us) server_negotiation.cc:299] Negotiation successful
0929 06:34:15.744619 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:34:15.744902 17832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:15.736908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:57667)
0929 06:34:15.737080 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:15.737118 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:15.737584 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:15.737783 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:15.737786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:15.738342 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:15.738544 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:15.738549 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:15.739206 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:15.739207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:15.740069 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:15.740072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:15.740403 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:15.740404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:15.740497 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:15.740938 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:15.740947 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:15.742256 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:15.743638 (+ 1382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:15.743644 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:15.743645 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:15.743851 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:15.744034 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:15.744035 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:15.744035 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:15.744131 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:15.744334 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:15.744337 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:15.744455 (+ 118us) client_negotiation.cc:769] Sending connection context
0929 06:34:15.744535 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 06:34:15.744647 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260929 06:34:15.745515 17830 heartbeater.cc:347] Connected to a master server at 127.9.61.126:42315
I20260929 06:34:15.745633 17830 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:15.745890 17830 heartbeater.cc:511] Master 127.9.61.126:42315 requested a full tablet report, sending...
I20260929 06:34:15.745901 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 17701
I20260929 06:34:15.746019 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:34:15.746237 9461 external_mini_cluster.cc:1428] Setting key df3d5a639642d0b33b6ba78cfdc37194
I20260929 06:34:15.746521 17639 ts_manager.cc:194] Registered new tserver with Master: 460e690e431f4288a7c52bb10ef33d28 (127.9.61.65:35735)
I20260929 06:34:15.747278 17639 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:57667
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:34:15.770390 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:42315
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:15.851437 17835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:15.851671 17835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:15.851707 17835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:15.852864 17835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:15.852933 17835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:15.852974 17835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:34:15.854377 17835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:42315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:15.854632 17835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:15.854900 17835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:15.859762 17841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:15.859879 17843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:15.859835 17840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:15.860044 17835 server_base.cc:1034] running on GCE node
I20260929 06:34:15.860286 17835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:15.860531 17835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:15.861719 17835 hybrid_clock.cc:648] HybridClock initialized: now 1790663655861695 us; error 38 us; skew 500 ppm
Sep 29 06:34:15 dist-test-slave-601b krb5kdc[17594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663655, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:15.864655 17835 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:34:15.865114 17835 webserver.cc:460] Webserver started at http://127.9.61.66:33329/ using document root <none> and password file <none>
I20260929 06:34:15.865355 17835 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:15.865403 17835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:15.865595 17835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:15.866742 17835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "d9dd44cb624c4475be4ca3bbdc75a063"
format_stamp: "Formatted at 2026-09-29 06:34:15 on dist-test-slave-601b"
server_key: "58f8e10abdc368819d9af5f6553fb9b7"
server_key_iv: "ce080a08ad78eeaa50291ef16888a873"
server_key_version: "encryptionkey@0"
I20260929 06:34:15.867129 17835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "d9dd44cb624c4475be4ca3bbdc75a063"
format_stamp: "Formatted at 2026-09-29 06:34:15 on dist-test-slave-601b"
server_key: "58f8e10abdc368819d9af5f6553fb9b7"
server_key_iv: "ce080a08ad78eeaa50291ef16888a873"
server_key_version: "encryptionkey@0"
I20260929 06:34:15.868614 17835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:34:15.869331 17850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:15.869527 17835 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:15.869619 17835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "d9dd44cb624c4475be4ca3bbdc75a063"
format_stamp: "Formatted at 2026-09-29 06:34:15 on dist-test-slave-601b"
server_key: "58f8e10abdc368819d9af5f6553fb9b7"
server_key_iv: "ce080a08ad78eeaa50291ef16888a873"
server_key_version: "encryptionkey@0"
I20260929 06:34:15.869693 17835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:15.891330 17835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:15.894084 17835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:15.894261 17835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:15.894528 17835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:15.894901 17835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:15.894942 17835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:15.894987 17835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:15.895016 17835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:15.901316 17835 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:43933
I20260929 06:34:15.901368 17963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:43933 every 8 connection(s)
I20260929 06:34:15.901721 17835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:34:15.905115 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 17835
I20260929 06:34:15.905251 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:34:15.905471 9461 external_mini_cluster.cc:1428] Setting key 72d2cb2097e942abb7b0dfdc7f15939d
Sep 29 06:34:15 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663655, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:15.912398 17696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:15.902471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:43151 (local address 127.9.61.126:42315)
0929 06:34:15.902539 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:15.902541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:15.902768 (+ 227us) server_negotiation.cc:407] Connection header received
0929 06:34:15.903274 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:15.903276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:15.903286 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:15.903341 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:15.904394 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:15.904898 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:15.906418 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:15.906603 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:15.906659 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:15.909184 (+ 2525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:15.909186 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:15.909186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:15.909195 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:15.910727 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:15.911202 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:15.911203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:15.911203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:15.911272 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:15.911555 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:15.911556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:15.911556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:15.911687 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:15.911766 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:15.912203 (+ 437us) server_negotiation.cc:299] Negotiation successful
0929 06:34:15.912298 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:34:15.912611 17966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:15.902444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:43151)
0929 06:34:15.902639 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:15.902676 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:15.903187 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:15.903398 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:15.903402 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:15.904078 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:15.904282 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:15.904287 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:15.904991 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:15.904992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:15.906332 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:15.906335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:15.906691 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:15.906692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:15.906855 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:15.907364 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:15.907375 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:15.909076 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:15.910862 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:15.910870 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:15.910872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:15.911116 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:15.911344 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:15.911345 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:15.911346 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:15.911477 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:15.911769 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:15.911776 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:15.912052 (+ 276us) client_negotiation.cc:769] Sending connection context
0929 06:34:15.912181 (+ 129us) client_negotiation.cc:240] Negotiation successful
0929 06:34:15.912355 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":108,"threads_started":1}
I20260929 06:34:15.913338 17964 heartbeater.cc:347] Connected to a master server at 127.9.61.126:42315
I20260929 06:34:15.913463 17964 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:15.913677 17964 heartbeater.cc:511] Master 127.9.61.126:42315 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
I20260929 06:34:15.914110 17639 ts_manager.cc:194] Registered new tserver with Master: d9dd44cb624c4475be4ca3bbdc75a063 (127.9.61.66:43933)
I20260929 06:34:15.914518 17639 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:43151
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:34:15.931229 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:42315
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:16.013151 17969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:16.013343 17969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:16.013370 17969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:16.014572 17969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:16.014626 17969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:16.014676 17969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:34:16.016085 17969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:42315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:16.016317 17969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:16.016538 17969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:16.021270 17977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:16.021296 17975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:16.021306 17974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:16.021559 17969 server_base.cc:1034] running on GCE node
I20260929 06:34:16.021763 17969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:16.021994 17969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:16.023155 17969 hybrid_clock.cc:648] HybridClock initialized: now 1790663656023142 us; error 48 us; skew 500 ppm
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663656, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:16.025635 17969 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:34:16.026008 17969 webserver.cc:460] Webserver started at http://127.9.61.67:33805/ using document root <none> and password file <none>
I20260929 06:34:16.026180 17969 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:16.026219 17969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:16.026305 17969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:16.027277 17969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "ecc6ac1a04b2403cb97b7f800a1d3397"
format_stamp: "Formatted at 2026-09-29 06:34:16 on dist-test-slave-601b"
server_key: "f20984987c32b243bf7ebcf1d0761c63"
server_key_iv: "04d776de3f348b6f2518e1fa4d23455e"
server_key_version: "encryptionkey@0"
I20260929 06:34:16.027592 17969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "ecc6ac1a04b2403cb97b7f800a1d3397"
format_stamp: "Formatted at 2026-09-29 06:34:16 on dist-test-slave-601b"
server_key: "f20984987c32b243bf7ebcf1d0761c63"
server_key_iv: "04d776de3f348b6f2518e1fa4d23455e"
server_key_version: "encryptionkey@0"
I20260929 06:34:16.028916 17969 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:34:16.029568 17984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.029753 17969 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:34:16.029842 17969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "ecc6ac1a04b2403cb97b7f800a1d3397"
format_stamp: "Formatted at 2026-09-29 06:34:16 on dist-test-slave-601b"
server_key: "f20984987c32b243bf7ebcf1d0761c63"
server_key_iv: "04d776de3f348b6f2518e1fa4d23455e"
server_key_version: "encryptionkey@0"
I20260929 06:34:16.029915 17969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:16.052143 17969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:16.054013 17969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:16.054170 17969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:16.054442 17969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:16.054757 17969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:16.054790 17969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.054811 17969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:16.054824 17969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.061007 17969 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:40329
I20260929 06:34:16.061065 18097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:40329 every 8 connection(s)
I20260929 06:34:16.061374 17969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:34:16.065729 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 17969
I20260929 06:34:16.065891 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:34:16.066105 9461 external_mini_cluster.cc:1428] Setting key d823aeb256189869955496dbfa5c3649
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663656, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:16.071053 18100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:16.062077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:56625)
0929 06:34:16.062251 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:16.062298 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:16.062810 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:16.063079 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:16.063083 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:16.063803 (+ 720us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:16.064074 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.064079 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.064780 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.064781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.065556 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.065558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.066014 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.066015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.066182 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.066831 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:16.066840 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:16.068309 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:16.069907 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:16.069912 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:16.069913 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:16.070126 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:16.070296 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:16.070296 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:16.070296 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:16.070385 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:16.070582 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:16.070586 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:16.070691 (+ 105us) client_negotiation.cc:769] Sending connection context
0929 06:34:16.070769 (+ 78us) client_negotiation.cc:240] Negotiation successful
0929 06:34:16.070882 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260929 06:34:16.071056 17696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:16.062108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:56625 (local address 127.9.61.126:42315)
0929 06:34:16.062175 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:16.062177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:16.062383 (+ 206us) server_negotiation.cc:407] Connection header received
0929 06:34:16.062937 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:16.062938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:16.062951 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:16.063009 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:16.064177 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.064689 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.065683 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.065935 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.066000 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.068396 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:16.068398 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:16.068398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:16.068405 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:16.069818 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:16.070188 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:16.070189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:16.070189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:16.070236 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:16.070437 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:16.070438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:16.070438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:16.070531 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:16.070579 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:16.070820 (+ 241us) server_negotiation.cc:299] Negotiation successful
0929 06:34:16.070927 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:34:16.071483 18098 heartbeater.cc:347] Connected to a master server at 127.9.61.126:42315
I20260929 06:34:16.071565 18098 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:16.071703 18098 heartbeater.cc:511] Master 127.9.61.126:42315 requested a full tablet report, sending...
I20260929 06:34:16.072113 17639 ts_manager.cc:194] Registered new tserver with Master: ecc6ac1a04b2403cb97b7f800a1d3397 (127.9.61.67:40329)
I20260929 06:34:16.072443 17639 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:56625
I20260929 06:34:16.077876 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab.
Entry for principal oryx/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab.
WARNING: no policy specified for oryx/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab.
Entry for principal oryx/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab.
WARNING: no policy specified for oryx/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab.
Entry for principal oryx/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab.
I20260929 06:34:16.146354 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 17701
I20260929 06:34:16.150823 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 17835
I20260929 06:34:16.155136 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 17969
I20260929 06:34:16.159409 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 17607
I20260929 06:34:16.164362 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:42315
--webserver_interface=127.9.61.126
--webserver_port=33785
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:42315
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:16.243547 18107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:16.243782 18107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:16.243818 18107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:16.244969 18107 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:16.245035 18107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:16.245060 18107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:16.245081 18107 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:16.245107 18107 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:16.246543 18107 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:42315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:42315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=33785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:16.246803 18107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:16.247021 18107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:16.251711 18115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:16.251732 18113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:16.251919 18107 server_base.cc:1034] running on GCE node
W20260929 06:34:16.251794 18112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:16.252233 18107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:16.252530 18107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:16.253684 18107 hybrid_clock.cc:648] HybridClock initialized: now 1790663656253677 us; error 41 us; skew 500 ppm
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663656, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:16.256021 18107 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:34:16.256475 18107 webserver.cc:460] Webserver started at http://127.9.61.126:33785/ using document root <none> and password file <none>
I20260929 06:34:16.256693 18107 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:16.256788 18107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:16.258172 18107 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:16.258826 18122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.259002 18107 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:16.259096 18107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "31d550e7411149aaae12e3bcea40aa06"
format_stamp: "Formatted at 2026-09-29 06:34:15 on dist-test-slave-601b"
server_key: "ff82bc1f0a2429789d39ed2360fd3c21"
server_key_iv: "0a6dffdea084ceb42a6c1f0f2f661da3"
server_key_version: "encryptionkey@0"
I20260929 06:34:16.259429 18107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:16.280560 18107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:16.282526 18107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:16.282691 18107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:16.286743 18107 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:42315
I20260929 06:34:16.286783 18174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:42315 every 8 connection(s)
I20260929 06:34:16.287170 18107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:16.288595 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 18107
I20260929 06:34:16.288676 18175 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:34:16.288893 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:35735
--local_ip_for_outbound_sockets=127.9.61.65
--tserver_master_addrs=127.9.61.126:42315
--webserver_port=40417
--webserver_interface=127.9.61.65
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.61.65
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:34:16.289433 18175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06: Bootstrap starting.
I20260929 06:34:16.297199 18175 log.cc:824] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:16.298795 18175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:34:16.299088 18175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06: Bootstrap complete.
I20260929 06:34:16.301287 18175 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d550e7411149aaae12e3bcea40aa06" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 42315 } }
I20260929 06:34:16.301614 18175 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d550e7411149aaae12e3bcea40aa06, State: Initialized, Role: FOLLOWER
I20260929 06:34:16.301779 18175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d550e7411149aaae12e3bcea40aa06" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 42315 } }
I20260929 06:34:16.301844 18175 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:16.301901 18175 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:16.301949 18175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 1 FOLLOWER]: Advancing to term 2
I20260929 06:34:16.302922 18175 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d550e7411149aaae12e3bcea40aa06" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 42315 } }
I20260929 06:34:16.303006 18175 leader_election.cc:302] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31d550e7411149aaae12e3bcea40aa06; no voters:
I20260929 06:34:16.303186 18175 leader_election.cc:288] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 06:34:16.303246 18179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 06:34:16.303380 18179 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [term 2 LEADER]: Becoming Leader. State: Replica: 31d550e7411149aaae12e3bcea40aa06, State: Running, Role: LEADER
I20260929 06:34:16.303475 18175 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:16.303479 18179 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d550e7411149aaae12e3bcea40aa06" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 42315 } }
I20260929 06:34:16.303778 18181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31d550e7411149aaae12e3bcea40aa06. Latest consensus state: current_term: 2 leader_uuid: "31d550e7411149aaae12e3bcea40aa06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d550e7411149aaae12e3bcea40aa06" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 42315 } } }
I20260929 06:34:16.303870 18181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:16.303776 18180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "31d550e7411149aaae12e3bcea40aa06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d550e7411149aaae12e3bcea40aa06" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 42315 } } }
I20260929 06:34:16.304072 18180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:16.304423 18184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:16.304895 18184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:16.305014 18184 catalog_manager.cc:1259] Loaded cluster ID: 6d6c7834eab54424b66a05bd1db3cf42
I20260929 06:34:16.305045 18184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:34:16.306265 18184 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:16.306427 18184 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 31d550e7411149aaae12e3bcea40aa06: Loaded TSK: 0
I20260929 06:34:16.306632 18184 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 06:34:16.370208 18177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:16.370406 18177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:16.370429 18177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:16.371541 18177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:16.371582 18177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:16.371608 18177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:34:16.373067 18177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.65.keytab
--principal=oryx/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:35735
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=40417
--tserver_master_addrs=127.9.61.126:42315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:16.373296 18177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:16.373544 18177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:16.379390 18202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:16.379412 18201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:16.379485 18204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:16.379645 18177 server_base.cc:1034] running on GCE node
I20260929 06:34:16.379858 18177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:16.380198 18177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:16.381364 18177 hybrid_clock.cc:648] HybridClock initialized: now 1790663656381349 us; error 30 us; skew 500 ppm
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663656, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:16.384097 18177 init.cc:377] Logged in from keytab as oryx/127.9.61.65@KRBTEST.COM (short username oryx)
I20260929 06:34:16.384555 18177 webserver.cc:460] Webserver started at http://127.9.61.65:40417/ using document root <none> and password file <none>
I20260929 06:34:16.384796 18177 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:16.384888 18177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:16.386333 18177 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:16.386989 18211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.387162 18177 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:16.387261 18177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "460e690e431f4288a7c52bb10ef33d28"
format_stamp: "Formatted at 2026-09-29 06:34:15 on dist-test-slave-601b"
server_key: "f5177049bc68fa9911418da6d7e95bbe"
server_key_iv: "4e75a514e94393d6cd8f0c8e407bdfb6"
server_key_version: "encryptionkey@0"
I20260929 06:34:16.387617 18177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:16.409757 18177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:16.412106 18177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:16.412271 18177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:16.412518 18177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:16.412834 18177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:16.412896 18177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.412938 18177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:16.412966 18177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.419062 18177 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:35735
I20260929 06:34:16.419103 18324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:35735 every 8 connection(s)
I20260929 06:34:16.419448 18177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:34:16.423882 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 18177
I20260929 06:34:16.424227 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:43933
--local_ip_for_outbound_sockets=127.9.61.66
--tserver_master_addrs=127.9.61.126:42315
--webserver_port=33329
--webserver_interface=127.9.61.66
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.61.66
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:16.429524 18327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:16.420174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:45299)
0929 06:34:16.420391 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:16.420445 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:16.421046 (+ 601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:16.421490 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:16.421494 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:16.422318 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:16.422590 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.422597 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.423665 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.423666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.425031 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.425035 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.425803 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.425804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.425941 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.426501 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:16.426510 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:16.429248 (+ 2738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":86,"threads_started":1}
W20260929 06:34:16.429791 18325 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:42315 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.61.126:42315: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
W20260929 06:34:16.429832 18328 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:16.420306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:45299 (local address 127.9.61.126:42315)
0929 06:34:16.420500 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:16.420509 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:16.420546 (+ 37us) server_negotiation.cc:407] Connection header received
0929 06:34:16.421241 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:16.421246 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:16.421288 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:16.421405 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:16.422706 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.423561 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.425135 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.425687 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.425828 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.429409 (+ 3581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:45299: BlockingRecv error: recv got EOF from 127.9.61.65:45299 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":77,"threads_started":1}
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:16.435586 18327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:16.430026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:45531)
0929 06:34:16.430228 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:16.430240 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:16.430286 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:16.430501 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:16.430502 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:16.430670 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:16.430736 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.430738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.431600 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.431601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.432550 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.432553 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.432982 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.432984 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.433061 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.433564 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:16.433570 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:16.435498 (+ 1928us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":80,"threads_started":1}
W20260929 06:34:16.435631 18328 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:16.430211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:45531 (local address 127.9.61.126:42315)
0929 06:34:16.430252 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:16.430254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:16.430270 (+ 16us) server_negotiation.cc:407] Connection header received
0929 06:34:16.430366 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:16.430367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:16.430378 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:16.430467 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:16.430828 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.431508 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.432643 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.432898 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.432969 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.435569 (+ 2600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:45531: BlockingRecv error: recv got EOF from 127.9.61.65:45531 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:16.440618 18327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:16.435909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:41177)
0929 06:34:16.435982 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:16.435995 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:16.436042 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:16.436171 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:16.436172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:16.436327 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:16.436375 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.436377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.437131 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.437132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.437941 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.437943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.438294 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.438295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.438354 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.438750 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:16.438755 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:16.440549 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54}
W20260929 06:34:16.440693 18328 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:16.436022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:41177 (local address 127.9.61.126:42315)
0929 06:34:16.436057 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:16.436059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:16.436073 (+ 14us) server_negotiation.cc:407] Connection header received
0929 06:34:16.436092 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:16.436092 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:16.436100 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:16.436148 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:16.436532 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.437049 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.438041 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.438218 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.438284 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.440624 (+ 2340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:41177: BlockingRecv error: recv got EOF from 127.9.61.65:41177 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260929 06:34:16.440884 18325 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:34:16.511612 18329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:16.511830 18329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:16.511861 18329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:16.513096 18329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:16.513149 18329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:16.513176 18329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:34:16.514622 18329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.66.keytab
--principal=oryx/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:43933
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=33329
--tserver_master_addrs=127.9.61.126:42315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:16.514894 18329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:16.515142 18329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:16.520170 18336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:16.520154 18338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:16.520141 18335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:16.520359 18329 server_base.cc:1034] running on GCE node
I20260929 06:34:16.520699 18329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:16.520972 18329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:16.522135 18329 hybrid_clock.cc:648] HybridClock initialized: now 1790663656522118 us; error 39 us; skew 500 ppm
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663656, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:16.524688 18329 init.cc:377] Logged in from keytab as oryx/127.9.61.66@KRBTEST.COM (short username oryx)
I20260929 06:34:16.525221 18329 webserver.cc:460] Webserver started at http://127.9.61.66:33329/ using document root <none> and password file <none>
I20260929 06:34:16.525455 18329 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:16.525540 18329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:16.526919 18329 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:16.527514 18345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.527712 18329 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.527810 18329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "d9dd44cb624c4475be4ca3bbdc75a063"
format_stamp: "Formatted at 2026-09-29 06:34:15 on dist-test-slave-601b"
server_key: "58f8e10abdc368819d9af5f6553fb9b7"
server_key_iv: "ce080a08ad78eeaa50291ef16888a873"
server_key_version: "encryptionkey@0"
I20260929 06:34:16.528249 18329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:16.541896 18329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:16.544019 18329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:16.544198 18329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:16.544454 18329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:16.544775 18329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:16.544828 18329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.544881 18329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:16.544906 18329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.550851 18329 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:43933
I20260929 06:34:16.550887 18458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:43933 every 8 connection(s)
I20260929 06:34:16.551280 18329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
W20260929 06:34:16.559053 18328 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:16.552104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:45261 (local address 127.9.61.126:42315)
0929 06:34:16.552156 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:16.552158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:16.552401 (+ 243us) server_negotiation.cc:407] Connection header received
0929 06:34:16.552996 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:16.552997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:16.553013 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:16.553065 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:16.554081 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.554585 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.555619 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.555828 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.555920 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.558995 (+ 3075us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:45261: BlockingRecv error: recv got EOF from 127.9.61.66:45261 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:34:16.559121 18461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:16.552107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:45261)
0929 06:34:16.552259 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:16.552299 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:16.552870 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:16.553148 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:16.553152 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:16.553764 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:16.553967 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.553972 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.554685 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.554686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.555514 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.555516 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.555932 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.555933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.556088 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.556675 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:16.556685 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:16.558910 (+ 2225us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
W20260929 06:34:16.559367 18459 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:42315 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.61.126:42315: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
I20260929 06:34:16.561296 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 18329
I20260929 06:34:16.561635 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:40329
--local_ip_for_outbound_sockets=127.9.61.67
--tserver_master_addrs=127.9.61.126:42315
--webserver_port=33805
--webserver_interface=127.9.61.67
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.61.67
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:16.564393 18461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:16.559593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:58545)
0929 06:34:16.559643 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:16.559654 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:16.559698 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:16.559823 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:16.559824 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:16.560021 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:16.560075 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.560076 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.560735 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.560736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.561431 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.561434 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.561859 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.561860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.561934 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.562435 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:16.562441 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:16.564314 (+ 1873us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 06:34:16.564481 18328 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:16.559659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:58545 (local address 127.9.61.126:42315)
0929 06:34:16.559722 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:16.559724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:16.559735 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:34:16.559762 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:16.559763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:16.559773 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:16.559822 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:16.560159 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.560629 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.561517 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.561773 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.561852 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.564414 (+ 2562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:58545: BlockingRecv error: recv got EOF from 127.9.61.66:58545 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:16.569638 18461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:16.564804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:43485)
0929 06:34:16.564923 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:16.564935 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:16.564990 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:16.565133 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:16.565134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:16.565300 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:16.565341 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.565343 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.565953 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.565954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.566868 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.566870 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.567190 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.567191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.567261 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.567646 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:16.567651 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:16.569531 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100}
W20260929 06:34:16.569659 18328 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:16.564873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:43485 (local address 127.9.61.126:42315)
0929 06:34:16.564927 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:16.564929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:16.564983 (+ 54us) server_negotiation.cc:407] Connection header received
0929 06:34:16.565057 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:16.565057 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:16.565065 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:16.565111 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:16.565415 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.565873 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.566956 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.567121 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.567165 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.569614 (+ 2449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:43485: BlockingRecv error: recv got EOF from 127.9.61.66:43485 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260929 06:34:16.569790 18459 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:34:16.645133 18462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:16.645349 18462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:16.645372 18462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:16.646489 18462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:16.646574 18462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:16.646620 18462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:34:16.648118 18462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/krb5kdc/oryx_127.9.61.67.keytab
--principal=oryx/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:40329
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=33805
--tserver_master_addrs=127.9.61.126:42315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:16.648430 18462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:16.648684 18462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:16.653714 18467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:16.653724 18468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:16.653810 18462 server_base.cc:1034] running on GCE node
W20260929 06:34:16.653730 18470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:16.654152 18462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:16.654438 18462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:16.655606 18462 hybrid_clock.cc:648] HybridClock initialized: now 1790663656655600 us; error 43 us; skew 500 ppm
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663656, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:16.658099 18462 init.cc:377] Logged in from keytab as oryx/127.9.61.67@KRBTEST.COM (short username oryx)
I20260929 06:34:16.658555 18462 webserver.cc:460] Webserver started at http://127.9.61.67:33805/ using document root <none> and password file <none>
I20260929 06:34:16.658804 18462 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:16.658890 18462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:16.660341 18462 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:34:16.660956 18477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.661115 18462 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:34:16.661206 18462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "ecc6ac1a04b2403cb97b7f800a1d3397"
format_stamp: "Formatted at 2026-09-29 06:34:16 on dist-test-slave-601b"
server_key: "f20984987c32b243bf7ebcf1d0761c63"
server_key_iv: "04d776de3f348b6f2518e1fa4d23455e"
server_key_version: "encryptionkey@0"
I20260929 06:34:16.661580 18462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:16.678387 18462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:16.680521 18462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:16.680682 18462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:16.680922 18462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:16.681221 18462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:16.681273 18462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.681326 18462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:16.681356 18462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:16.687233 18462 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:40329
I20260929 06:34:16.687289 18590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:40329 every 8 connection(s)
I20260929 06:34:16.687623 18462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:16.695130 18593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:16.688350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:39235)
0929 06:34:16.688531 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:16.688570 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:16.689057 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:16.689288 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:16.689291 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:16.689939 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:16.690139 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.690144 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.690856 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.690857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.691669 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.691671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.692126 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.692128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.692250 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.692744 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:16.692753 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:16.694975 (+ 2222us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
W20260929 06:34:16.695133 18328 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:16.688404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:39235 (local address 127.9.61.126:42315)
0929 06:34:16.688489 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:16.688492 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:16.688675 (+ 183us) server_negotiation.cc:407] Connection header received
0929 06:34:16.689154 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:16.689155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:16.689166 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:16.689220 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:16.690229 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.690764 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.691747 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.691989 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.692074 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.695085 (+ 3011us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:39235: BlockingRecv error: recv got EOF from 127.9.61.67:39235 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260929 06:34:16.695377 18591 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:42315 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.61.126:42315: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
I20260929 06:34:16.697449 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 18462
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:16.699878 18593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:16.695624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:57417)
0929 06:34:16.695679 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:16.695689 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:16.695730 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:16.695932 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:16.695933 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:16.696085 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:16.696128 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.696130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.696716 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.696717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.697200 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.697201 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.697527 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.697529 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.697609 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.698085 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:16.698090 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:16.699829 (+ 1739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":37}
W20260929 06:34:16.700037 18328 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:16.695786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:57417 (local address 127.9.61.126:42315)
0929 06:34:16.695835 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:16.695837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:16.695843 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:34:16.695861 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:16.695862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:16.695870 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:16.695909 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:16.696194 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.696652 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.697275 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.697448 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.697501 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.699932 (+ 2431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:57417: BlockingRecv error: recv got EOF from 127.9.61.67:57417 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:16 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:16.704777 18593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:16.700220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:34959)
0929 06:34:16.700257 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:16.700266 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:16.700298 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:16.700429 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:16.700430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:16.700559 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:16.700594 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.700596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.701262 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.701263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.701757 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:16.701759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.702117 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.702117 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:16.702170 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.702606 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:16.702610 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:16.704687 (+ 2077us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":26}
W20260929 06:34:16.704811 18328 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:16.700283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:34959 (local address 127.9.61.126:42315)
0929 06:34:16.700315 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:16.700317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:16.700327 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:34:16.700346 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:16.700347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:16.700355 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:16.700414 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:16.700658 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.701161 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.701857 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.702036 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.702106 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.704752 (+ 2646us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:34959: BlockingRecv error: recv got EOF from 127.9.61.67:34959 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 06:34:16.705008 18591 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 06:34:16.706471 18595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:16.697937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54902 (local address 127.9.61.126:42315)
0929 06:34:16.698039 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:16.698041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:16.698172 (+ 131us) server_negotiation.cc:407] Connection header received
0929 06:34:16.698214 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:16.698215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:16.698228 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:16.698303 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:16.698901 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.699393 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.700671 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:16.700897 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:16.700945 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:16.702271 (+ 1326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:16.702294 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:16.702294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:16.702591 (+ 297us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:16.704675 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:16.705143 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:16.705147 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:16.705147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:16.705300 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:16.705488 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:16.705488 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:16.705488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:16.705723 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:16.705874 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:16.706221 (+ 347us) server_negotiation.cc:299] Negotiation successful
0929 06:34:16.706364 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":66,"threads_started":1}
Sep 29 06:34:17 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:17 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:17.445927 18596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:17.441335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:54705)
0929 06:34:17.441484 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:17.441495 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:17.441545 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:17.441713 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:17.441714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:17.441877 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:17.441924 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:17.441926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:17.442584 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:17.442585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:17.443155 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:17.443156 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:17.443516 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:17.443517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:17.443559 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:17.444036 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:17.444040 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:17.445861 (+ 1821us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":89,"threads_started":1}
W20260929 06:34:17.446076 18597 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:17.441419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:54705 (local address 127.9.61.126:42315)
0929 06:34:17.441583 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:17.441584 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:17.441594 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:34:17.441618 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:17.441618 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:17.441628 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:17.441695 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:17.442000 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:17.442505 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:17.443252 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:17.443445 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:17.443501 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:17.445973 (+ 2472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:54705: BlockingRecv error: recv got EOF from 127.9.61.65:54705 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
Sep 29 06:34:17 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:17 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:17.574579 18598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:17.570187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:38463)
0929 06:34:17.570343 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:17.570353 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:17.570412 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:17.570540 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:17.570541 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:17.570701 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:17.570750 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:17.570751 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:17.571385 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:17.571386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:17.571967 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:17.571969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:17.572277 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:17.572278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:17.572316 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:17.572787 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:17.572792 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:17.574509 (+ 1717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
W20260929 06:34:17.574683 18597 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:17.570261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:38463 (local address 127.9.61.126:42315)
0929 06:34:17.570309 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:17.570311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:17.570396 (+ 85us) server_negotiation.cc:407] Connection header received
0929 06:34:17.570455 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:17.570456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:17.570465 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:17.570519 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:17.570812 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:17.571295 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:17.572031 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:17.572212 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:17.572265 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:17.574613 (+ 2348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:38463: BlockingRecv error: recv got EOF from 127.9.61.66:38463 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Sep 29 06:34:17 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:17 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:17.710408 18599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:17.705415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:51111)
0929 06:34:17.705585 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:17.705598 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:17.705699 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:17.705840 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:17.705841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:17.706030 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:17.706076 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:17.706078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:17.706776 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:17.706777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:17.707333 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:17.707335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:17.707713 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:17.707714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:17.707788 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:17.708321 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:17.708326 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:17.710299 (+ 1973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":84,"threads_started":1}
W20260929 06:34:17.710443 18597 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:17.705494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:51111 (local address 127.9.61.126:42315)
0929 06:34:17.705569 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:17.705571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:17.705680 (+ 109us) server_negotiation.cc:407] Connection header received
0929 06:34:17.705761 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:17.705761 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:17.705776 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:17.705833 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:17.706163 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:17.706667 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:17.707429 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:17.707626 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:17.707712 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:17.710377 (+ 2665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:51111: BlockingRecv error: recv got EOF from 127.9.61.67:51111 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 29 06:34:18 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:18 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:18.457007 18600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:18.446423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:57159)
0929 06:34:18.446572 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:18.446582 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:18.446627 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:18.446764 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:18.446765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:18.446930 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:18.446978 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:18.446979 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:18.447628 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:18.447629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:18.448195 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:18.448197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:18.448536 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:18.448537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:18.448602 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:18.455051 (+ 6449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:18.455056 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:18.456903 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
W20260929 06:34:18.457041 18601 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:18.446502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:57159 (local address 127.9.61.126:42315)
0929 06:34:18.446639 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:18.446641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:18.446665 (+ 24us) server_negotiation.cc:407] Connection header received
0929 06:34:18.446685 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:18.446686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:18.446695 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:18.446746 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:18.447041 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:18.447537 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:18.448267 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:18.448454 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:18.448501 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:18.456972 (+ 8471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:57159: BlockingRecv error: recv got EOF from 127.9.61.65:57159 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":83,"threads_started":1}
Sep 29 06:34:18 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:18 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:18.579821 18602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:18.575096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:45337)
0929 06:34:18.575265 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:18.575278 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:18.575349 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:18.575505 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:18.575506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:18.575696 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:18.575759 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:18.575761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:18.576510 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:18.576511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:18.577047 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:18.577067 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:18.577466 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:18.577467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:18.577524 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:18.577997 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:18.578001 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:18.579757 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":92,"threads_started":1}
W20260929 06:34:18.579936 18601 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:18.575191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:45337 (local address 127.9.61.126:42315)
0929 06:34:18.575268 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:18.575271 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:18.575347 (+ 76us) server_negotiation.cc:407] Connection header received
0929 06:34:18.575434 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:18.575435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:18.575447 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:18.575491 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:18.575850 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:18.576427 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:18.577151 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:18.577389 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:18.577467 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:18.579865 (+ 2398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:45337: BlockingRecv error: recv got EOF from 127.9.61.66:45337 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Sep 29 06:34:18 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:18 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:18.715616 18603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:18.710908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:58097)
0929 06:34:18.711067 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:18.711082 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:18.711130 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:18.711283 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:18.711284 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:18.711443 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:18.711509 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:18.711511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:18.712172 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:18.712173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:18.712860 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:18.712862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:18.713299 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:18.713300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:18.713355 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:18.713791 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:18.713796 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:18.715515 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":100,"threads_started":1}
W20260929 06:34:18.715654 18601 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:18.711041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:58097 (local address 127.9.61.126:42315)
0929 06:34:18.711111 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:18.711112 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:18.711121 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:18.711194 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:18.711195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:18.711206 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:18.711259 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:18.711581 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:18.712093 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:18.712950 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:18.713198 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:18.713296 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:18.715590 (+ 2294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:58097: BlockingRecv error: recv got EOF from 127.9.61.67:58097 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Sep 29 06:34:19 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:19 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:19.462244 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:19.457520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:59377)
0929 06:34:19.457695 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:19.457706 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:19.457773 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:19.457938 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:19.457939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:19.458101 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:19.458152 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:19.458154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:19.458800 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:19.458801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:19.459342 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:19.459343 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:19.459672 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:19.459673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:19.459712 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:19.460248 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:19.460253 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:19.462145 (+ 1892us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":94,"threads_started":1}
W20260929 06:34:19.462316 18605 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:19.457614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:59377 (local address 127.9.61.126:42315)
0929 06:34:19.457744 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:19.457746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:19.457755 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:19.457847 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:19.457848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:19.457858 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:19.457917 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:19.458215 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:19.458712 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:19.459417 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:19.459608 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:19.459662 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:19.462243 (+ 2581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:59377: BlockingRecv error: recv got EOF from 127.9.61.65:59377 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":80,"threads_started":1}
Sep 29 06:34:19 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:19 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:19.585032 18606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:19.580364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:40461)
0929 06:34:19.580542 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:19.580554 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:19.580631 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:19.580810 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:19.580811 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:19.580989 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:19.581035 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:19.581036 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:19.581725 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:19.581726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:19.582274 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:19.582276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:19.582644 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:19.582645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:19.582712 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:19.583183 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:19.583188 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:19.584926 (+ 1738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":91,"threads_started":1}
W20260929 06:34:19.585071 18605 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:19.580447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:40461 (local address 127.9.61.126:42315)
0929 06:34:19.580523 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:19.580526 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:19.580618 (+ 92us) server_negotiation.cc:407] Connection header received
0929 06:34:19.580697 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:19.580698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:19.580711 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:19.580798 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:19.581124 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:19.581631 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:19.582359 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:19.582558 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:19.582644 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:19.585005 (+ 2361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:40461: BlockingRecv error: recv got EOF from 127.9.61.66:40461 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 29 06:34:19 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:19 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:19.721513 18607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:19.716138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:47431)
0929 06:34:19.716301 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:19.716326 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:19.716422 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:19.716585 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:19.716586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:19.716768 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:19.716820 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:19.716822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:19.717517 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:19.717518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:19.718070 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:19.718072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:19.718458 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:19.718459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:19.718524 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:19.719084 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:19.719089 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:19.721403 (+ 2314us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":93,"threads_started":1}
W20260929 06:34:19.721558 18605 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:19.716245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:47431 (local address 127.9.61.126:42315)
0929 06:34:19.716318 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:19.716320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:19.716407 (+ 87us) server_negotiation.cc:407] Connection header received
0929 06:34:19.716504 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:19.716505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:19.716519 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:19.716566 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:19.716919 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:19.717430 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:19.718166 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:19.718368 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:19.718455 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:19.721491 (+ 3036us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:47431: BlockingRecv error: recv got EOF from 127.9.61.67:47431 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Sep 29 06:34:20 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:20 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:20.467475 18608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:20.462791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:34955)
0929 06:34:20.462974 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:20.462986 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:20.463056 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:20.463238 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:20.463239 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:20.463403 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:20.463451 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:20.463452 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:20.464155 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:20.464155 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:20.464690 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:20.464692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:20.465023 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:20.465024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:20.465084 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:20.465619 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:20.465631 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:20.467417 (+ 1786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":104,"threads_started":1}
W20260929 06:34:20.467610 18609 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:20.462872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:34955 (local address 127.9.61.126:42315)
0929 06:34:20.462972 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:20.462975 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:20.463059 (+ 84us) server_negotiation.cc:407] Connection header received
0929 06:34:20.463097 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:20.463097 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:20.463107 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:20.463227 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:20.463517 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:20.464086 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:20.464767 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:20.464956 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:20.465011 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:20.467502 (+ 2491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:34955: BlockingRecv error: recv got EOF from 127.9.61.65:34955 (error 108)
Metrics: {"server-negotiator.queue_time_us":78,"thread_start_us":47,"threads_started":1}
Sep 29 06:34:20 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:20 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:20.590034 18610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:20.585482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:36263)
0929 06:34:20.585642 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:20.585652 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:20.585725 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:20.585888 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:20.585889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:20.586048 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:20.586098 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:20.586100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:20.586757 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:20.586758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:20.587281 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:20.587283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:20.587626 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:20.587628 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:20.587686 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:20.588199 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:20.588204 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:20.589930 (+ 1726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":81,"threads_started":1}
W20260929 06:34:20.590130 18609 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:20.585552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:36263 (local address 127.9.61.126:42315)
0929 06:34:20.585593 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:20.585595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:20.585715 (+ 120us) server_negotiation.cc:407] Connection header received
0929 06:34:20.585772 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:20.585773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:20.585782 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:20.585840 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:20.586166 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:20.586649 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:20.587350 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:20.587543 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:20.587593 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:20.590069 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:36263: BlockingRecv error: recv got EOF from 127.9.61.66:36263 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Sep 29 06:34:20 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:20 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:20.726615 18611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:20.721990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:47127)
0929 06:34:20.722182 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:20.722194 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:20.722284 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:20.722414 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:20.722415 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:20.722586 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:20.722630 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:20.722632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:20.723378 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:20.723379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:20.723907 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:20.723908 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:20.724323 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:20.724324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:20.724381 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:20.724784 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:20.724788 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:20.726521 (+ 1733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":88,"threads_started":1}
W20260929 06:34:20.726655 18609 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:20.722083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:47127 (local address 127.9.61.126:42315)
0929 06:34:20.722170 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:20.722172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:20.722270 (+ 98us) server_negotiation.cc:407] Connection header received
0929 06:34:20.722351 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:20.722351 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:20.722365 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:20.722410 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:20.722791 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:20.723293 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:20.724050 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:20.724237 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:20.724321 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:20.726594 (+ 2273us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:47127: BlockingRecv error: recv got EOF from 127.9.61.67:47127 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Sep 29 06:34:21 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:21 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:21.472544 18612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:21.467916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:59709)
0929 06:34:21.468083 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:21.468094 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:21.468151 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:21.468303 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:21.468304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:21.468458 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:21.468505 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:21.468507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:21.469140 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:21.469141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:21.469658 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:21.469659 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:21.469990 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:21.469990 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:21.470028 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:21.470519 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:21.470523 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:21.472447 (+ 1924us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":104,"threads_started":1}
W20260929 06:34:21.472604 18613 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:21.468015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:59709 (local address 127.9.61.126:42315)
0929 06:34:21.468128 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:21.468129 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:21.468138 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:21.468207 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:21.468208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:21.468218 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:21.468278 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:21.468560 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:21.469072 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:21.469744 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:21.469927 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:21.469975 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:21.472529 (+ 2554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:59709: BlockingRecv error: recv got EOF from 127.9.61.65:59709 (error 108)
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":64,"threads_started":1}
Sep 29 06:34:21 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:21 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:21.595645 18614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:21.590704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:57259)
0929 06:34:21.590920 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:21.590933 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:21.590999 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:21.591162 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:21.591163 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:21.591376 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:21.591425 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:21.591427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:21.592081 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:21.592081 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:21.592653 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:21.592654 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:21.593121 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:21.593122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:21.593179 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:21.593771 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:21.593776 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:21.595587 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":105,"threads_started":1}
W20260929 06:34:21.595788 18613 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:21.590815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:57259 (local address 127.9.61.126:42315)
0929 06:34:21.590859 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:21.590862 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:21.590998 (+ 136us) server_negotiation.cc:407] Connection header received
0929 06:34:21.591070 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:21.591071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:21.591085 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:21.591140 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:21.591493 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:21.592013 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:21.592745 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:21.592962 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:21.593019 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:21.595705 (+ 2686us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:57259: BlockingRecv error: recv got EOF from 127.9.61.66:57259 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Sep 29 06:34:21 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:21 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:21.731608 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:21.727070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:47593)
0929 06:34:21.727190 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:21.727207 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:21.727253 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:21.727402 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:21.727403 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:21.727553 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:21.727599 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:21.727601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:21.728241 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:21.728242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:21.728752 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:21.728753 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:21.729071 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:21.729071 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:21.729107 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:21.729535 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:21.729540 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:21.731541 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":70,"threads_started":1}
W20260929 06:34:21.731710 18613 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:21.727173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:47593 (local address 127.9.61.126:42315)
0929 06:34:21.727241 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:21.727243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:21.727250 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:34:21.727316 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:21.727317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:21.727327 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:21.727387 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:21.727660 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:21.728170 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:21.728825 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:21.729005 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:21.729060 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:21.731622 (+ 2562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:47593: BlockingRecv error: recv got EOF from 127.9.61.67:47593 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 29 06:34:22 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:22 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:22.477490 18616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:22.472972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:58243)
0929 06:34:22.473126 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:22.473137 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:22.473195 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:22.473324 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:22.473325 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:22.473475 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:22.473522 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:22.473524 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:22.474232 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:22.474233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:22.474734 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:22.474735 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:22.475063 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:22.475064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:22.475103 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:22.475535 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:22.475539 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:22.477432 (+ 1893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":105,"threads_started":1}
W20260929 06:34:22.477612 18617 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:22.473064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:58243 (local address 127.9.61.126:42315)
0929 06:34:22.473193 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:22.473195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:22.473203 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:34:22.473245 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:22.473246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:22.473256 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:22.473308 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:22.473613 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:22.474162 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:22.474808 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:22.474997 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:22.475052 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:22.477524 (+ 2472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:58243: BlockingRecv error: recv got EOF from 127.9.61.65:58243 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":68,"threads_started":1}
Sep 29 06:34:22 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:22 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:22.600692 18618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:22.596148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:38329)
0929 06:34:22.596336 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:22.596349 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:22.596420 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:22.596558 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:22.596559 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:22.596733 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:22.596783 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:22.596785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:22.597398 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:22.597398 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:22.597920 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:22.597921 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:22.598242 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:22.598243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:22.598285 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:22.598838 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:22.598843 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:22.600634 (+ 1791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":85,"threads_started":1}
W20260929 06:34:22.600788 18617 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:22.596235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:38329 (local address 127.9.61.126:42315)
0929 06:34:22.596340 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:22.596342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:22.596399 (+ 57us) server_negotiation.cc:407] Connection header received
0929 06:34:22.596484 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:22.596485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:22.596495 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:22.596534 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:22.596851 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:22.597335 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:22.598003 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:22.598178 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:22.598226 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:22.600728 (+ 2502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:38329: BlockingRecv error: recv got EOF from 127.9.61.66:38329 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Sep 29 06:34:22 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:22 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:22.736739 18619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:22.732187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:37503)
0929 06:34:22.732321 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:22.732336 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:22.732392 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:22.732517 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:22.732518 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:22.732691 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:22.732740 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:22.732742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:22.733379 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:22.733380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:22.733905 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:22.733907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:22.734256 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:22.734258 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:22.734312 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:22.734770 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:22.734774 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:22.736648 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
W20260929 06:34:22.736848 18617 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:22.732281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:37503 (local address 127.9.61.126:42315)
0929 06:34:22.732334 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:22.732336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:22.732388 (+ 52us) server_negotiation.cc:407] Connection header received
0929 06:34:22.732435 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:22.732435 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:22.732447 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:22.732498 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:22.732815 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:22.733314 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:22.733976 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:22.734149 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:22.734199 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:22.736773 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:37503: BlockingRecv error: recv got EOF from 127.9.61.67:37503 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Sep 29 06:34:23 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:23 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:23.486929 18620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:23.478025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:54661)
0929 06:34:23.478235 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:23.478247 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:23.478319 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:23.478453 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:23.478454 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:23.478611 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:23.478659 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:23.478661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:23.479359 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:23.479359 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:23.479870 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:23.479872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:23.480215 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:23.480216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:23.480264 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:23.484798 (+ 4534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:23.484803 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:23.486816 (+ 2013us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":83,"threads_started":1}
W20260929 06:34:23.486986 18621 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:23.478086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:54661 (local address 127.9.61.126:42315)
0929 06:34:23.478256 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:23.478259 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:23.478315 (+ 56us) server_negotiation.cc:407] Connection header received
0929 06:34:23.478364 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:23.478365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:23.478375 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:23.478434 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:23.478749 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:23.479286 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:23.479962 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:23.480151 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:23.480212 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:23.486908 (+ 6696us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:54661: BlockingRecv error: recv got EOF from 127.9.61.65:54661 (error 108)
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":112,"threads_started":1}
Sep 29 06:34:23 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:23 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:23.605839 18622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:23.601229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:60385)
0929 06:34:23.601386 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:23.601396 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:23.601449 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:23.601573 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:23.601574 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:23.601740 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:23.601796 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:23.601798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:23.602419 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:23.602419 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:23.602953 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:23.602955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:23.603281 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:23.603282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:23.603356 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:23.603802 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:23.603807 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:23.605776 (+ 1969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
W20260929 06:34:23.605942 18621 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:23.601327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:60385 (local address 127.9.61.126:42315)
0929 06:34:23.601403 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:23.601405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:23.601436 (+ 31us) server_negotiation.cc:407] Connection header received
0929 06:34:23.601491 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:23.601492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:23.601502 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:23.601558 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:23.601861 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:23.602353 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:23.603020 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:23.603224 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:23.603273 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:23.605870 (+ 2597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:60385: BlockingRecv error: recv got EOF from 127.9.61.66:60385 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 29 06:34:23 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:23 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:23.741941 18623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:23.737505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:53855)
0929 06:34:23.737662 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:23.737676 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:23.737736 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:23.737866 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:23.737867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:23.738028 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:23.738076 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:23.738078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:23.738679 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:23.738679 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:23.739197 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:23.739198 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:23.739503 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:23.739504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:23.739541 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:23.740086 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:23.740090 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:23.741873 (+ 1783us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
W20260929 06:34:23.742107 18621 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:23.737576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:53855 (local address 127.9.61.126:42315)
0929 06:34:23.737658 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:23.737660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:23.737733 (+ 73us) server_negotiation.cc:407] Connection header received
0929 06:34:23.737779 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:23.737780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:23.737793 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:23.737846 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:23.738133 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:23.738615 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:23.739270 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:23.739443 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:23.739491 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:23.742014 (+ 2523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:53855: BlockingRecv error: recv got EOF from 127.9.61.67:53855 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Sep 29 06:34:24 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:24 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:24.492467 18624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:24.487502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:50131)
0929 06:34:24.487645 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:24.487660 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:24.487757 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:24.487907 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:24.487907 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:24.488081 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:24.488128 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:24.488130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:24.488861 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:24.488862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:24.489569 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:24.489572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:24.490050 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:24.490051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:24.490113 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:24.490614 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:24.490618 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:24.492412 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
W20260929 06:34:24.492583 18625 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:24.487639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:50131 (local address 127.9.61.126:42315)
0929 06:34:24.487796 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:24.487797 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:24.487805 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:34:24.487825 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:24.487825 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:24.487834 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:24.487889 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:24.488250 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:24.488787 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:24.489666 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:24.489961 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:24.490035 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:24.492500 (+ 2465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:50131: BlockingRecv error: recv got EOF from 127.9.61.65:50131 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":98,"threads_started":1}
Sep 29 06:34:24 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:24 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:24.611016 18626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:24.606366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:39173)
0929 06:34:24.606503 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:24.606514 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:24.606567 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:24.606709 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:24.606710 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:24.606876 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:24.606922 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:24.606924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:24.607711 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:24.607711 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:24.608255 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:24.608256 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:24.608589 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:24.608590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:24.608630 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:24.609168 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:24.609173 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:24.610959 (+ 1786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
W20260929 06:34:24.611179 18625 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:24.606453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:39173 (local address 127.9.61.126:42315)
0929 06:34:24.606532 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:24.606534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:24.606557 (+ 23us) server_negotiation.cc:407] Connection header received
0929 06:34:24.606617 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:24.606617 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:24.606628 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:24.606693 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:24.606994 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:24.607639 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:24.608329 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:24.608519 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:24.608576 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:24.611068 (+ 2492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:39173: BlockingRecv error: recv got EOF from 127.9.61.66:39173 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Sep 29 06:34:24 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:24 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:24.747164 18627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:24.742471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:46993)
0929 06:34:24.742622 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:24.742635 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:24.742697 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:24.742860 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:24.742861 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:24.743036 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:24.743083 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:24.743085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:24.743748 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:24.743749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:24.744304 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:24.744306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:24.744673 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:24.744674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:24.744739 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:24.745244 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:24.745250 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:24.747068 (+ 1818us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
W20260929 06:34:24.747215 18625 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:24.742578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:46993 (local address 127.9.61.126:42315)
0929 06:34:24.742664 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:24.742666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:24.742679 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:34:24.742784 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:24.742785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:24.742800 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:24.742846 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:24.743162 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:24.743660 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:24.744392 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:24.744587 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:24.744671 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:24.747150 (+ 2479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:46993: BlockingRecv error: recv got EOF from 127.9.61.67:46993 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Sep 29 06:34:25 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:25 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:25.497566 18628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:25.493015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:41735)
0929 06:34:25.493157 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:25.493167 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:25.493214 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:25.493380 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:25.493381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:25.493544 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:25.493592 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:25.493594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:25.494222 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:25.494223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:25.494754 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:25.494755 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:25.495071 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:25.495072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:25.495112 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:25.495623 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:25.495627 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:25.497506 (+ 1879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":81,"threads_started":1}
W20260929 06:34:25.497707 18629 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:25.493108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:41735 (local address 127.9.61.126:42315)
0929 06:34:25.493249 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:25.493252 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:25.493260 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:34:25.493291 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:25.493291 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:25.493301 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:25.493363 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:25.493657 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:25.494152 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:25.494826 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:25.495007 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:25.495056 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:25.497613 (+ 2557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:41735: BlockingRecv error: recv got EOF from 127.9.61.65:41735 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":82,"threads_started":1}
Sep 29 06:34:25 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:25 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:25.616079 18630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:25.611502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:57481)
0929 06:34:25.611631 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:25.611649 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:25.611702 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:25.611869 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:25.611870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:25.612106 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:25.612155 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:25.612157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:25.612772 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:25.612773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:25.613295 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:25.613296 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:25.613608 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:25.613608 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:25.613646 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:25.614193 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:25.614197 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:25.616021 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
W20260929 06:34:25.616150 18629 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:25.611585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:57481 (local address 127.9.61.126:42315)
0929 06:34:25.611658 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:25.611660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:25.611691 (+ 31us) server_negotiation.cc:407] Connection header received
0929 06:34:25.611762 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:25.611763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:25.611792 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:25.611850 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:25.612228 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:25.612709 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:25.613361 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:25.613547 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:25.613595 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:25.616101 (+ 2506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:57481: BlockingRecv error: recv got EOF from 127.9.61.66:57481 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 29 06:34:25 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:25 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:25.752390 18631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:25.747656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:48793)
0929 06:34:25.747828 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:25.747846 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:25.747909 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:25.748082 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:25.748083 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:25.748313 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:25.748361 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:25.748363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:25.749141 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:25.749142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:25.749690 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:25.749691 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:25.750051 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:25.750052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:25.750113 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:25.750545 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:25.750550 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:25.752322 (+ 1772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":86,"threads_started":1}
W20260929 06:34:25.752465 18629 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:25.747783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:48793 (local address 127.9.61.126:42315)
0929 06:34:25.747861 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:25.747862 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:25.747910 (+ 48us) server_negotiation.cc:407] Connection header received
0929 06:34:25.747990 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:25.747991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:25.748005 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:25.748070 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:25.748448 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:25.749065 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:25.749777 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:25.749968 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:25.750051 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:25.752406 (+ 2355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:48793: BlockingRecv error: recv got EOF from 127.9.61.67:48793 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Sep 29 06:34:26 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:26 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:26.502971 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:26.498064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:44793)
0929 06:34:26.498246 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:26.498260 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:26.498350 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:26.498520 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:26.498521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:26.498712 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:26.498761 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:26.498763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:26.499454 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:26.499455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:26.500071 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:26.500073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:26.500473 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:26.500474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:26.500541 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:26.501056 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:26.501060 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:26.502866 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":83,"threads_started":1}
W20260929 06:34:26.503032 18633 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:26.498118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:44793 (local address 127.9.61.126:42315)
0929 06:34:26.498250 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:26.498253 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:26.498377 (+ 124us) server_negotiation.cc:407] Connection header received
0929 06:34:26.498425 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:26.498426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:26.498439 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:26.498502 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:26.498844 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:26.499366 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:26.500164 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:26.500382 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:26.500470 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:26.502959 (+ 2489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:44793: BlockingRecv error: recv got EOF from 127.9.61.65:44793 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
Sep 29 06:34:26 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:26 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:26.621776 18634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:26.616803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:50213)
0929 06:34:26.616969 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:26.616981 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:26.617049 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:26.617188 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:26.617189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:26.617368 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:26.617416 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:26.617418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:26.618142 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:26.618144 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:26.618843 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:26.618846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:26.619226 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:26.619227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:26.619285 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:26.619759 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:26.619764 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:26.621710 (+ 1946us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":91,"threads_started":1}
W20260929 06:34:26.621910 18633 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:26.616859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:50213 (local address 127.9.61.126:42315)
0929 06:34:26.616927 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:26.616929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:26.617049 (+ 120us) server_negotiation.cc:407] Connection header received
0929 06:34:26.617113 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:26.617113 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:26.617124 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:26.617164 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:26.617482 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:26.618046 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:26.618930 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:26.619130 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:26.619222 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:26.621828 (+ 2606us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:50213: BlockingRecv error: recv got EOF from 127.9.61.66:50213 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Sep 29 06:34:26 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:26 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:26.757616 18635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:26.752980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:34615)
0929 06:34:26.753154 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:26.753169 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:26.753279 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:26.753431 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:26.753432 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:26.753620 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:26.753666 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:26.753668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:26.754351 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:26.754353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:26.754894 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:26.754895 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:26.755251 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:26.755252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:26.755314 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:26.755799 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:26.755804 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:26.757556 (+ 1752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":65,"threads_started":1}
W20260929 06:34:26.757781 18633 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:26.753113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:34615 (local address 127.9.61.126:42315)
0929 06:34:26.753178 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:26.753181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:26.753261 (+ 80us) server_negotiation.cc:407] Connection header received
0929 06:34:26.753336 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:26.753337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:26.753351 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:26.753431 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:26.753771 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:26.754259 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:26.754979 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:26.755164 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:26.755248 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:26.757672 (+ 2424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:34615: BlockingRecv error: recv got EOF from 127.9.61.67:34615 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 29 06:34:27 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:27 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:27.508428 18636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:27.503435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:36951)
0929 06:34:27.503580 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:27.503590 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:27.503641 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:27.503999 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:27.504000 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:27.504164 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:27.504210 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:27.504212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:27.505250 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:27.505251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:27.505784 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:27.505785 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:27.506137 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:27.506138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:27.506178 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:27.506642 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:27.506647 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:27.508360 (+ 1713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
W20260929 06:34:27.508566 18637 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:27.503512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:36951 (local address 127.9.61.126:42315)
0929 06:34:27.503611 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:27.503613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:27.503629 (+ 16us) server_negotiation.cc:407] Connection header received
0929 06:34:27.503802 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:27.503802 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:27.503813 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:27.503914 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:27.504313 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:27.505151 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:27.505872 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:27.506067 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:27.506125 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:27.508454 (+ 2329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:36951: BlockingRecv error: recv got EOF from 127.9.61.65:36951 (error 108)
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":51,"threads_started":1}
Sep 29 06:34:27 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:27 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:27.626616 18638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:27.622366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:59677)
0929 06:34:27.622505 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:27.622517 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:27.622563 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:27.622701 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:27.622701 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:27.622862 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:27.622905 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:27.622907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:27.623519 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:27.623520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:27.624058 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:27.624060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:27.624364 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:27.624365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:27.624401 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:27.624809 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:27.624813 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:27.626507 (+ 1694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":81,"threads_started":1}
W20260929 06:34:27.626650 18637 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:27.622484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:59677 (local address 127.9.61.126:42315)
0929 06:34:27.622565 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:27.622567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:27.622578 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:34:27.622640 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:27.622641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:27.622651 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:27.622689 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:27.622966 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:27.623453 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:27.624118 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:27.624303 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:27.624352 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:27.626584 (+ 2232us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:59677: BlockingRecv error: recv got EOF from 127.9.61.66:59677 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 29 06:34:27 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:27 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:27.762952 18639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:27.758171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:53685)
0929 06:34:27.758326 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:27.758336 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:27.758404 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:27.758538 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:27.758539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:27.758704 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:27.758751 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:27.758753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:27.759389 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:27.759390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:27.760088 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:27.760091 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:27.760403 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:27.760404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:27.760441 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:27.760886 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:27.760891 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:27.762842 (+ 1951us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":103,"threads_started":1}
W20260929 06:34:27.762987 18637 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:27.758252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:53685 (local address 127.9.61.126:42315)
0929 06:34:27.758323 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:27.758325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:27.758400 (+ 75us) server_negotiation.cc:407] Connection header received
0929 06:34:27.758449 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:27.758450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:27.758464 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:27.758519 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:27.758813 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:27.759314 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:27.760155 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:27.760340 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:27.760395 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:27.762921 (+ 2526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:53685: BlockingRecv error: recv got EOF from 127.9.61.67:53685 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 29 06:34:28 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:28 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:28.520426 18640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:28.512251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:49117)
0929 06:34:28.512490 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:28.512503 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:28.512563 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:28.512770 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:28.512770 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:28.512974 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:28.513030 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:28.513032 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:28.513690 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:28.513691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:28.514532 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:28.514535 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:28.514905 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:28.514906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:28.514964 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:28.518192 (+ 3228us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:28.518198 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:28.520313 (+ 2115us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":71,"threads_started":1}
W20260929 06:34:28.520488 18641 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:28.512425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:49117 (local address 127.9.61.126:42315)
0929 06:34:28.512559 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:28.512562 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:28.512571 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:28.512615 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:28.512616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:28.512628 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:28.512705 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:28.513091 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:28.513601 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:28.514618 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:28.514823 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:28.514876 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:28.520412 (+ 5536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:49117: BlockingRecv error: recv got EOF from 127.9.61.65:49117 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":52,"threads_started":1}
Sep 29 06:34:28 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:28 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:28.631934 18642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:28.627117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:39611)
0929 06:34:28.627291 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:28.627303 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:28.627373 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:28.627523 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:28.627524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:28.627721 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:28.627776 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:28.627778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:28.628464 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:28.628465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:28.629092 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:28.629095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:28.629464 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:28.629465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:28.629506 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:28.629964 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:28.629969 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:28.631836 (+ 1867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":116,"threads_started":1}
W20260929 06:34:28.632005 18641 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:28.627200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:39611 (local address 127.9.61.126:42315)
0929 06:34:28.627263 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:28.627265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:28.627373 (+ 108us) server_negotiation.cc:407] Connection header received
0929 06:34:28.627435 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:28.627436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:28.627446 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:28.627501 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:28.627848 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:28.628371 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:28.629187 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:28.629397 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:28.629449 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:28.631922 (+ 2473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:39611: BlockingRecv error: recv got EOF from 127.9.61.66:39611 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Sep 29 06:34:28 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:28 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:28.768211 18643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:28.763416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:56989)
0929 06:34:28.763570 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:28.763584 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:28.763675 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:28.763868 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:28.763868 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:28.764094 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:28.764135 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:28.764137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:28.764816 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:28.764817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:28.765495 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:28.765497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:28.765864 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:28.765865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:28.765918 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:28.766378 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:28.766382 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:28.768107 (+ 1725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
W20260929 06:34:28.768260 18641 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:28.763499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:56989 (local address 127.9.61.126:42315)
0929 06:34:28.763575 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:28.763577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:28.763656 (+ 79us) server_negotiation.cc:407] Connection header received
0929 06:34:28.763776 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:28.763777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:28.763803 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:28.763849 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:28.764223 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:28.764732 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:28.765581 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:28.765793 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:28.765866 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:28.768187 (+ 2321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:56989: BlockingRecv error: recv got EOF from 127.9.61.67:56989 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Sep 29 06:34:29 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:29 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:29.525770 18644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:29.521144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:43487)
0929 06:34:29.521398 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:29.521422 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:29.521476 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:29.521589 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:29.521590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:29.521749 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:29.521794 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:29.521795 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:29.522399 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:29.522399 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:29.522928 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:29.522930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:29.523248 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:29.523249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:29.523285 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:29.523692 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:29.523695 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:29.525699 (+ 2004us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":192,"threads_started":1}
W20260929 06:34:29.525864 18645 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:29.521346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:43487 (local address 127.9.61.126:42315)
0929 06:34:29.521478 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:29.521480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:29.521496 (+ 16us) server_negotiation.cc:407] Connection header received
0929 06:34:29.521519 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:29.521520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:29.521529 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:29.521586 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:29.521858 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:29.522334 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:29.523001 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:29.523185 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:29.523235 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:29.525792 (+ 2557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:43487: BlockingRecv error: recv got EOF from 127.9.61.65:43487 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
Sep 29 06:34:29 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:29 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:29.636839 18646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:29.632461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:38461)
0929 06:34:29.632628 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:29.632640 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:29.632714 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:29.632843 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:29.632844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:29.633019 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:29.633063 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:29.633064 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:29.633649 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:29.633649 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:29.634204 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:29.634205 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:29.634524 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:29.634524 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:29.634563 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:29.635020 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:29.635024 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:29.636773 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":71,"threads_started":1}
W20260929 06:34:29.636965 18645 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:29.632606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:38461 (local address 127.9.61.126:42315)
0929 06:34:29.632666 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:29.632668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:29.632699 (+ 31us) server_negotiation.cc:407] Connection header received
0929 06:34:29.632778 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:29.632778 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:29.632788 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:29.632830 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:29.633120 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:29.633586 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:29.634276 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:29.634462 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:29.634512 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:29.636866 (+ 2354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:38461: BlockingRecv error: recv got EOF from 127.9.61.66:38461 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Sep 29 06:34:29 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:29 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:29.773870 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:29.768804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:33175)
0929 06:34:29.768997 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:29.769008 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:29.769095 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:29.769283 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:29.769284 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:29.769470 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:29.769516 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:29.769517 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:29.770222 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:29.770223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:29.770746 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:29.770747 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:29.771124 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:29.771125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:29.771190 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:29.771686 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:29.771691 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:29.773764 (+ 2073us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":108,"threads_started":1}
W20260929 06:34:29.773909 18645 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:29.768902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:33175 (local address 127.9.61.126:42315)
0929 06:34:29.768976 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:29.768979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:29.769077 (+ 98us) server_negotiation.cc:407] Connection header received
0929 06:34:29.769195 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:29.769196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:29.769213 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:29.769266 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:29.769597 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:29.770119 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:29.770839 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:29.771024 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:29.771111 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:29.773845 (+ 2734us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:33175: BlockingRecv error: recv got EOF from 127.9.61.67:33175 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Sep 29 06:34:30 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:30 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:30.531065 18648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:30.526296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:50245)
0929 06:34:30.526490 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:30.526502 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:30.526559 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:30.526708 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:30.526709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:30.526873 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:30.526919 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:30.526920 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:30.527677 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:30.527678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:30.528223 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:30.528225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:30.528552 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:30.528552 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:30.528591 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:30.529082 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:30.529094 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:30.531009 (+ 1915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":91,"threads_started":1}
W20260929 06:34:30.531199 18649 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:30.526406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:50245 (local address 127.9.61.126:42315)
0929 06:34:30.526541 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:30.526545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:30.526558 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:34:30.526608 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:30.526609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:30.526619 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:30.526674 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:30.527020 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:30.527509 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:30.528290 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:30.528485 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:30.528542 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:30.531106 (+ 2564us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:50245: BlockingRecv error: recv got EOF from 127.9.61.65:50245 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":83,"threads_started":1}
Sep 29 06:34:30 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:30 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:30.641907 18650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:30.637315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:49531)
0929 06:34:30.637564 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:30.637576 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:30.637636 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:30.637777 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:30.637778 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:30.637970 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:30.638015 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:30.638016 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:30.638728 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:30.638729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:30.639244 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:30.639245 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:30.639624 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:30.639625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:30.639695 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:30.640138 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:30.640142 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:30.641838 (+ 1696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":72,"threads_started":1}
W20260929 06:34:30.642011 18649 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:30.637505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:49531 (local address 127.9.61.126:42315)
0929 06:34:30.637617 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:30.637619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:30.637630 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:34:30.637700 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:30.637701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:30.637712 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:30.637758 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:30.638110 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:30.638616 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:30.639338 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:30.639536 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:30.639623 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:30.641924 (+ 2301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:49531: BlockingRecv error: recv got EOF from 127.9.61.66:49531 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Sep 29 06:34:30 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:30 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.67@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:30.783406 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:30.774492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.67:37951)
0929 06:34:30.774656 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:30.774668 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:30.774739 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:30.774873 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:30.774873 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:30.775034 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:30.775079 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:30.775080 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:30.775708 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:30.775709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:30.776310 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:30.776312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:30.776620 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:30.776621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:30.776660 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:30.781603 (+ 4943us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:30.781609 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:30.783347 (+ 1738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":106,"threads_started":1}
W20260929 06:34:30.783547 18649 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:30.774571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:37951 (local address 127.9.61.126:42315)
0929 06:34:30.774642 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:30.774644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:30.774738 (+ 94us) server_negotiation.cc:407] Connection header received
0929 06:34:30.774794 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:30.774795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:30.774807 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:30.774849 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:30.775140 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:30.775639 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:30.776382 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:30.776557 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:30.776605 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:30.783462 (+ 6857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.67:37951: BlockingRecv error: recv got EOF from 127.9.61.67:37951 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 29 06:34:31 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:31 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.65@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:31.536406 18652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:31.531608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.65:33481)
0929 06:34:31.531794 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:31.531814 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:31.531868 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:31.532028 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:31.532029 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:31.532278 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:31.532341 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:31.532344 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:31.533036 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:31.533037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:31.533567 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:31.533568 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:31.533944 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:31.533945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:31.534002 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:31.534486 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:31.534493 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:31.536351 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":100,"threads_started":1}
W20260929 06:34:31.536548 18653 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:31.531659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:33481 (local address 127.9.61.126:42315)
0929 06:34:31.531841 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:31.531843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:31.531855 (+ 12us) server_negotiation.cc:407] Connection header received
0929 06:34:31.531921 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:31.531922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:31.531932 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:31.532006 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:31.532435 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:31.532940 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:31.533655 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:31.533859 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:31.533944 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:31.536460 (+ 2516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.65:33481: BlockingRecv error: recv got EOF from 127.9.61.65:33481 (error 108)
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":112,"threads_started":1}
Sep 29 06:34:31 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
Sep 29 06:34:31 dist-test-slave-601b krb5kdc[17594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.61.66@KRBTEST.COM for oryx/127.9.61.126@KRBTEST.COM, Server not found in Kerberos database
I20260929 06:34:31.647119 18654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:31.642439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:42315 (local address 127.9.61.66:50467)
0929 06:34:31.642620 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:31.642634 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:31.642739 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:31.642916 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:31.642917 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:31.643099 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:31.643144 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:31.643146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:31.643828 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:31.643829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:31.644412 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:31.644414 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:31.644805 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:31.644806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:31.644863 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:31.645315 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:31.645319 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:31.647019 (+ 1700us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.61.126:42315: Server oryx/127.9.61.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":83,"threads_started":1}
W20260929 06:34:31.647189 18653 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:31.642538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:50467 (local address 127.9.61.126:42315)
0929 06:34:31.642625 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:31.642628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:31.642719 (+ 91us) server_negotiation.cc:407] Connection header received
0929 06:34:31.642819 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:31.642820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:31.642834 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:31.642911 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:31.643235 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:31.643730 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:31.644521 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:31.644720 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:31.644805 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:31.647109 (+ 2304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.61.66:50467: BlockingRecv error: recv got EOF from 127.9.61.66:50467 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260929 06:34:31.704002 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 18177
I20260929 06:34:31.708792 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 18329
I20260929 06:34:31.712989 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 18462
I20260929 06:34:31.716840 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 18107
2026-09-29T06:34:31Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17431 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-29T06:34:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:31Z Disabled control of system clock
I20260929 06:34:31.743788 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:36293
--webserver_interface=127.9.61.126
--webserver_port=0
--builtin_ntp_servers=127.9.61.84:45857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:36293
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260929 06:34:31.823509 18658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:31.823700 18658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:31.823719 18658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:31.824915 18658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:31.824955 18658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:31.824967 18658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:31.824980 18658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:31.824991 18658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:31.826205 18658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:45857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:36293
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:36293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:31.826403 18658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:31.826630 18658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:31.831651 18664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:31.831646 18663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:31.831856 18658 server_base.cc:1034] running on GCE node
W20260929 06:34:31.831964 18666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:31.832245 18658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:31.832535 18658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:31.833711 18658 hybrid_clock.cc:648] HybridClock initialized: now 1790663671833701 us; error 29 us; skew 500 ppm
I20260929 06:34:31.834968 18658 webserver.cc:460] Webserver started at http://127.9.61.126:44867/ using document root <none> and password file <none>
I20260929 06:34:31.835230 18658 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:31.835304 18658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:31.835453 18658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:31.836669 18658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "676c1b3a890d4e81b281dfc25bc74f32"
format_stamp: "Formatted at 2026-09-29 06:34:31 on dist-test-slave-601b"
server_key: "2c8778bb88059e5c21eac8c6c9814b4c"
server_key_iv: "476e576c614fdabbbec5c472a5ea8dff"
server_key_version: "encryptionkey@0"
I20260929 06:34:31.837042 18658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "676c1b3a890d4e81b281dfc25bc74f32"
format_stamp: "Formatted at 2026-09-29 06:34:31 on dist-test-slave-601b"
server_key: "2c8778bb88059e5c21eac8c6c9814b4c"
server_key_iv: "476e576c614fdabbbec5c472a5ea8dff"
server_key_version: "encryptionkey@0"
I20260929 06:34:31.838301 18658 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:34:31.838984 18672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:31.839136 18658 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:31.839241 18658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "676c1b3a890d4e81b281dfc25bc74f32"
format_stamp: "Formatted at 2026-09-29 06:34:31 on dist-test-slave-601b"
server_key: "2c8778bb88059e5c21eac8c6c9814b4c"
server_key_iv: "476e576c614fdabbbec5c472a5ea8dff"
server_key_version: "encryptionkey@0"
I20260929 06:34:31.839325 18658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:31.852170 18658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:31.852483 18658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:31.852632 18658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:31.856407 18658 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:36293
I20260929 06:34:31.856439 18724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:36293 every 8 connection(s)
I20260929 06:34:31.856796 18658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:31.857471 18725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:31.857739 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 18658
I20260929 06:34:31.857859 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:31.858052 9461 external_mini_cluster.cc:1428] Setting key 06ad5291a22fb4760bc0e2ece3ab6166
I20260929 06:34:31.861353 18725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32: Bootstrap starting.
I20260929 06:34:31.862007 18725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:31.862331 18725 log.cc:824] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:31.863092 18725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32: No bootstrap required, opened a new log
I20260929 06:34:31.864210 18728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:31.858584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51212 (local address 127.9.61.126:36293)
0929 06:34:31.858792 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:31.858801 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:31.858833 (+ 32us) server_negotiation.cc:407] Connection header received
0929 06:34:31.859437 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:31.859447 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:31.859530 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:31.859703 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:31.859862 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:31.861279 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:31.862071 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:31.862690 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:31.862820 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:31.863477 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:31.863481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:31.863482 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:31.863687 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:31.863729 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:31.863744 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:31.863814 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:31.863874 (+ 60us) server_negotiation.cc:299] Negotiation successful
0929 06:34:31.863985 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
I20260929 06:34:31.865301 18725 raft_consensus.cc:348] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "676c1b3a890d4e81b281dfc25bc74f32" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36293 } }
I20260929 06:34:31.865435 18725 raft_consensus.cc:374] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:31.865458 18725 raft_consensus.cc:729] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 676c1b3a890d4e81b281dfc25bc74f32, State: Initialized, Role: FOLLOWER
I20260929 06:34:31.865600 18725 consensus_queue.cc:260] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "676c1b3a890d4e81b281dfc25bc74f32" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36293 } }
I20260929 06:34:31.865676 18725 raft_consensus.cc:388] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:31.865723 18725 raft_consensus.cc:482] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:31.865769 18725 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:31.866362 18725 raft_consensus.cc:504] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "676c1b3a890d4e81b281dfc25bc74f32" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36293 } }
I20260929 06:34:31.866474 18725 leader_election.cc:302] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 676c1b3a890d4e81b281dfc25bc74f32; no voters:
I20260929 06:34:31.866674 18725 leader_election.cc:288] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:31.866752 18730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:31.866895 18730 raft_consensus.cc:686] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [term 1 LEADER]: Becoming Leader. State: Replica: 676c1b3a890d4e81b281dfc25bc74f32, State: Running, Role: LEADER
I20260929 06:34:31.866946 18725 sys_catalog.cc:564] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:31.866981 18730 consensus_queue.cc:237] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "676c1b3a890d4e81b281dfc25bc74f32" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36293 } }
I20260929 06:34:31.867378 18731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "676c1b3a890d4e81b281dfc25bc74f32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "676c1b3a890d4e81b281dfc25bc74f32" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36293 } } }
I20260929 06:34:31.867475 18731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:31.867712 18732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 676c1b3a890d4e81b281dfc25bc74f32. Latest consensus state: current_term: 1 leader_uuid: "676c1b3a890d4e81b281dfc25bc74f32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "676c1b3a890d4e81b281dfc25bc74f32" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36293 } } }
I20260929 06:34:31.867832 18732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:31.868017 18738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:31.868580 18738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:31.870138 18738 catalog_manager.cc:1347] Generated new cluster ID: 0ded94e3ffb04ca0a1fe243407e39e5b
I20260929 06:34:31.870193 18738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:34:31.886262 18738 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:31.886962 18738 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:31.897254 18738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 676c1b3a890d4e81b281dfc25bc74f32: Generated new TSK 0
I20260929 06:34:31.897435 18738 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:34:31.902961 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:36293
--builtin_ntp_servers=127.9.61.84:45857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260929 06:34:31.984133 18749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:31.984338 18749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:31.984360 18749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:31.985565 18749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:31.985606 18749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:31.985631 18749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:34:31.986953 18749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:45857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:36293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:31.987211 18749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:31.987514 18749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:31.993397 18755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:31.993397 18757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:31.993659 18749 server_base.cc:1034] running on GCE node
W20260929 06:34:31.993692 18754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:31.993913 18749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:31.994177 18749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:31.995358 18749 hybrid_clock.cc:648] HybridClock initialized: now 1790663671995341 us; error 34 us; skew 500 ppm
I20260929 06:34:31.997020 18749 webserver.cc:460] Webserver started at http://127.9.61.65:45569/ using document root <none> and password file <none>
I20260929 06:34:31.997341 18749 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:31.997416 18749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:31.997572 18749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:31.999137 18749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "e2a7509b8d634ac680c2e9b96e4704d4"
format_stamp: "Formatted at 2026-09-29 06:34:31 on dist-test-slave-601b"
server_key: "1b4aec6cf1803e6ba3a035ab33392e5c"
server_key_iv: "c34b5d4092244864ef6eb1c529fba983"
server_key_version: "encryptionkey@0"
I20260929 06:34:31.999562 18749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "e2a7509b8d634ac680c2e9b96e4704d4"
format_stamp: "Formatted at 2026-09-29 06:34:31 on dist-test-slave-601b"
server_key: "1b4aec6cf1803e6ba3a035ab33392e5c"
server_key_iv: "c34b5d4092244864ef6eb1c529fba983"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.001346 18749 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260929 06:34:32.002456 18763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.002697 18749 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:32.002785 18749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "e2a7509b8d634ac680c2e9b96e4704d4"
format_stamp: "Formatted at 2026-09-29 06:34:31 on dist-test-slave-601b"
server_key: "1b4aec6cf1803e6ba3a035ab33392e5c"
server_key_iv: "c34b5d4092244864ef6eb1c529fba983"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.002856 18749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:32.031164 18749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:32.031507 18749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:32.031657 18749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:32.031896 18749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:32.032267 18749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:32.032325 18749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.032367 18749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:32.032394 18749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.038323 18749 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:33201
I20260929 06:34:32.038367 18876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:33201 every 8 connection(s)
I20260929 06:34:32.038717 18749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:34:32.044227 18728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.039445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:41217 (local address 127.9.61.126:36293)
0929 06:34:32.039514 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:32.039516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:32.039767 (+ 251us) server_negotiation.cc:407] Connection header received
0929 06:34:32.040384 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:32.040385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:32.040402 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:32.040450 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:32.041126 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:32.041695 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:32.042813 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:32.043026 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:32.043128 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:32.043927 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:32.043928 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:32.043928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:32.043933 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:32.043970 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:32.043974 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:32.044028 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:32.044120 (+ 92us) server_negotiation.cc:299] Negotiation successful
0929 06:34:32.044148 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:34:32.044440 18879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.039444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36293 (local address 127.9.61.65:41217)
0929 06:34:32.039636 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:32.039672 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:32.040265 (+ 593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:32.040530 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:32.040534 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:32.040550 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:32.041013 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:32.041018 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:32.041789 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:32.041790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:32.042717 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:32.042720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:32.043140 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:32.043141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:32.043275 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:32.043766 (+ 491us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:32.043767 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:32.043806 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:32.043828 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:32.044030 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:32.044035 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:32.044038 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:34:32.044123 (+ 85us) client_negotiation.cc:240] Negotiation successful
0929 06:34:32.044229 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":78,"threads_started":1}
I20260929 06:34:32.044997 18877 heartbeater.cc:347] Connected to a master server at 127.9.61.126:36293
I20260929 06:34:32.045085 18877 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:32.045286 18877 heartbeater.cc:511] Master 127.9.61.126:36293 requested a full tablet report, sending...
I20260929 06:34:32.045799 18689 ts_manager.cc:194] Registered new tserver with Master: e2a7509b8d634ac680c2e9b96e4704d4 (127.9.61.65:33201)
I20260929 06:34:32.046423 18689 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.61.65:41217
I20260929 06:34:32.048174 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 18749
I20260929 06:34:32.048254 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:34:32.048478 9461 external_mini_cluster.cc:1428] Setting key 3160c646dbaa1441898a1f8119130476
I20260929 06:34:32.049310 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:36293
--builtin_ntp_servers=127.9.61.84:45857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260929 06:34:32.127907 18880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:32.128115 18880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:32.128136 18880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:32.129204 18880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:32.129237 18880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:32.129261 18880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:34:32.130488 18880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:45857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:36293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:32.130656 18880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:32.130888 18880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:34:32.135860 18880 server_base.cc:1034] running on GCE node
W20260929 06:34:32.135841 18885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:32.135820 18886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:32.135842 18888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:32.136228 18880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:32.136524 18880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:32.137723 18880 hybrid_clock.cc:648] HybridClock initialized: now 1790663672137709 us; error 27 us; skew 500 ppm
I20260929 06:34:32.138932 18880 webserver.cc:460] Webserver started at http://127.9.61.66:45623/ using document root <none> and password file <none>
I20260929 06:34:32.139186 18880 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:32.139257 18880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:32.139410 18880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:32.140525 18880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "5c68d05ad3e04aaea04b32f81e74e59a"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "0500af6c2acf70ebbb2aeb74d515ecee"
server_key_iv: "07187f76b56fb9b78f79e7b3bbd8a61f"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.140893 18880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "5c68d05ad3e04aaea04b32f81e74e59a"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "0500af6c2acf70ebbb2aeb74d515ecee"
server_key_iv: "07187f76b56fb9b78f79e7b3bbd8a61f"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.142386 18880 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:34:32.143224 18894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.143468 18880 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:32.143602 18880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "5c68d05ad3e04aaea04b32f81e74e59a"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "0500af6c2acf70ebbb2aeb74d515ecee"
server_key_iv: "07187f76b56fb9b78f79e7b3bbd8a61f"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.143682 18880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:32.153697 18880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:32.153975 18880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:32.154121 18880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:32.154343 18880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:32.154660 18880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:32.154716 18880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.154754 18880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:32.154783 18880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.160333 18880 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:40165
I20260929 06:34:32.160367 19007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:40165 every 8 connection(s)
I20260929 06:34:32.160706 18880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:34:32.163769 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 18880
I20260929 06:34:32.163874 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:34:32.164072 9461 external_mini_cluster.cc:1428] Setting key 2f2a854600e55ac19100c15eff3fc6c4
I20260929 06:34:32.165014 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:36293
--builtin_ntp_servers=127.9.61.84:45857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260929 06:34:32.166402 18728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.161442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:38395 (local address 127.9.61.126:36293)
0929 06:34:32.161526 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:32.161528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:32.161736 (+ 208us) server_negotiation.cc:407] Connection header received
0929 06:34:32.162295 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:32.162296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:32.162307 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:32.162369 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:32.163014 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:32.163483 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:32.164924 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:32.165194 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:32.165259 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:32.166098 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:32.166099 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:32.166100 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:32.166103 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:32.166116 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:32.166120 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:32.166160 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:32.166274 (+ 114us) server_negotiation.cc:299] Negotiation successful
0929 06:34:32.166301 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260929 06:34:32.166664 19010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.161411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36293 (local address 127.9.61.66:38395)
0929 06:34:32.161606 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:32.161636 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:32.162106 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:32.162437 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:32.162440 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:32.162449 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:32.162938 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:32.162943 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:32.163555 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:32.163556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:32.164842 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:32.164845 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:32.165270 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:32.165271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:32.165433 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:32.165953 (+ 520us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:32.165953 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:32.165989 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:32.166016 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:32.166169 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:32.166172 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:32.166181 (+ 9us) client_negotiation.cc:769] Sending connection context
0929 06:34:32.166244 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 06:34:32.166355 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":96,"threads_started":1}
I20260929 06:34:32.167248 19008 heartbeater.cc:347] Connected to a master server at 127.9.61.126:36293
I20260929 06:34:32.167336 19008 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:32.167505 19008 heartbeater.cc:511] Master 127.9.61.126:36293 requested a full tablet report, sending...
I20260929 06:34:32.167907 18689 ts_manager.cc:194] Registered new tserver with Master: 5c68d05ad3e04aaea04b32f81e74e59a (127.9.61.66:40165)
I20260929 06:34:32.168293 18689 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.61.66:38395
W20260929 06:34:32.245900 19011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:32.246141 19011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:32.246167 19011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:32.247378 19011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:32.247417 19011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:32.247442 19011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:34:32.248751 19011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:45857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:36293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:32.248934 19011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:32.249163 19011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:32.253919 19019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:32.254060 19011 server_base.cc:1034] running on GCE node
W20260929 06:34:32.253939 19017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:32.253923 19016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:32.254349 19011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:32.254539 19011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:32.255678 19011 hybrid_clock.cc:648] HybridClock initialized: now 1790663672255675 us; error 51 us; skew 500 ppm
I20260929 06:34:32.256907 19011 webserver.cc:460] Webserver started at http://127.9.61.67:39841/ using document root <none> and password file <none>
I20260929 06:34:32.257098 19011 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:32.257138 19011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:32.257222 19011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:32.258162 19011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "00b6fff2bd6f46d7987931f439359a7f"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "41ce00cec0d572b55a7bf46646e04b0a"
server_key_iv: "41c67c4ccb622cc59ab218773ec731c5"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.258443 19011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "00b6fff2bd6f46d7987931f439359a7f"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "41ce00cec0d572b55a7bf46646e04b0a"
server_key_iv: "41c67c4ccb622cc59ab218773ec731c5"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.259646 19011 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:34:32.260357 19025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.260524 19011 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.260607 19011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "00b6fff2bd6f46d7987931f439359a7f"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "41ce00cec0d572b55a7bf46646e04b0a"
server_key_iv: "41c67c4ccb622cc59ab218773ec731c5"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.260658 19011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:32.271389 19011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:32.271625 19011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:32.271739 19011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:32.271911 19011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:32.272241 19011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:32.272275 19011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.272296 19011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:32.272308 19011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.278075 19011 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:38727
I20260929 06:34:32.278117 19138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:38727 every 8 connection(s)
I20260929 06:34:32.278431 19011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:34:32.280652 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 19011
I20260929 06:34:32.280752 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:34:32.280947 9461 external_mini_cluster.cc:1428] Setting key 6be42ae4eaff589f7051de4c6cca6120
I20260929 06:34:32.283684 18728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.279126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:41445 (local address 127.9.61.126:36293)
0929 06:34:32.279179 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:32.279181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:32.279412 (+ 231us) server_negotiation.cc:407] Connection header received
0929 06:34:32.279883 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:32.279884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:32.279895 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:32.279990 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:32.280728 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:32.281391 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:32.282523 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:32.282723 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:32.282776 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:32.283486 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:32.283488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:32.283488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:32.283492 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:32.283505 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:32.283508 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:32.283545 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:32.283598 (+ 53us) server_negotiation.cc:299] Negotiation successful
0929 06:34:32.283617 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:34:32.283882 19141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.279081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:36293 (local address 127.9.61.67:41445)
0929 06:34:32.279288 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:32.279320 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:32.279803 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:32.280058 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:32.280061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:32.280069 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:32.280612 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:32.280620 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:32.281485 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:32.281486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:32.282449 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:32.282452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:32.282796 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:32.282797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:32.282911 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:32.283365 (+ 454us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:32.283365 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:32.283391 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:32.283412 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:32.283552 (+ 140us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:32.283554 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:32.283556 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:34:32.283600 (+ 44us) client_negotiation.cc:240] Negotiation successful
0929 06:34:32.283676 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":123,"threads_started":1}
I20260929 06:34:32.284420 19139 heartbeater.cc:347] Connected to a master server at 127.9.61.126:36293
I20260929 06:34:32.284518 19139 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:32.284675 19139 heartbeater.cc:511] Master 127.9.61.126:36293 requested a full tablet report, sending...
I20260929 06:34:32.284981 18689 ts_manager.cc:194] Registered new tserver with Master: 00b6fff2bd6f46d7987931f439359a7f (127.9.61.67:38727)
I20260929 06:34:32.285336 18689 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.61.67:41445
I20260929 06:34:32.292697 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260929 06:34:32.294503 18728 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:32.293937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47124 (local address 127.9.61.126:36293)
0929 06:34:32.294018 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:32.294021 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:32.294112 (+ 91us) server_negotiation.cc:407] Connection header received
0929 06:34:32.294220 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:32.294221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:32.294238 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:32.294298 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:32.294437 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47124: BlockingRecv error: recv got EOF from 127.0.0.1:47124 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260929 06:34:32.294595 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 18749
I20260929 06:34:32.299067 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 18880
I20260929 06:34:32.303123 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 19011
I20260929 06:34:32.307109 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 18658
2026-09-29T06:34:32Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (589 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-29T06:34:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:32Z Disabled control of system clock
I20260929 06:34:32.333119 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:38139
--webserver_interface=127.9.61.126
--webserver_port=0
--builtin_ntp_servers=127.9.61.84:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:38139
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 06:34:32.411706 19150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:32.411898 19150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:32.411919 19150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:32.413089 19150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:32.413131 19150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:32.413144 19150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:32.413156 19150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:32.413168 19150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:32.414436 19150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:38139
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:38139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:32.414613 19150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:32.414835 19150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:32.419525 19158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:32.419584 19155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:32.419626 19156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:32.420110 19150 server_base.cc:1034] running on GCE node
I20260929 06:34:32.420325 19150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:32.420593 19150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:32.421731 19150 hybrid_clock.cc:648] HybridClock initialized: now 1790663672421718 us; error 28 us; skew 500 ppm
I20260929 06:34:32.422930 19150 webserver.cc:460] Webserver started at http://127.9.61.126:41445/ using document root <none> and password file <none>
I20260929 06:34:32.423128 19150 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:32.423167 19150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:32.423265 19150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:32.424324 19150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "fa6d91bb7f154feea5bc711b9f66b884"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "20c13d2635cd285f533c97a91cd68868"
server_key_iv: "85be45345775dff32fcc768d9b0b7171"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.424611 19150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "fa6d91bb7f154feea5bc711b9f66b884"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "20c13d2635cd285f533c97a91cd68868"
server_key_iv: "85be45345775dff32fcc768d9b0b7171"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.425910 19150 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:34:32.426635 19164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.426800 19150 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:32.426903 19150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "fa6d91bb7f154feea5bc711b9f66b884"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "20c13d2635cd285f533c97a91cd68868"
server_key_iv: "85be45345775dff32fcc768d9b0b7171"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.426977 19150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:32.430294 19150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:32.430554 19150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:32.430692 19150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:32.434451 19150 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:38139
I20260929 06:34:32.434480 19216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:38139 every 8 connection(s)
I20260929 06:34:32.434844 19150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:32.435488 19217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:32.436748 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 19150
I20260929 06:34:32.436920 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:32.437114 9461 external_mini_cluster.cc:1428] Setting key 0aeb170c1fe702757916bd8336fca242
I20260929 06:34:32.438506 19217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884: Bootstrap starting.
I20260929 06:34:32.439188 19217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:32.439527 19217 log.cc:824] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:32.439692 19220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.437655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50978 (local address 127.9.61.126:38139)
0929 06:34:32.437851 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:32.437858 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:32.437881 (+ 23us) server_negotiation.cc:407] Connection header received
0929 06:34:32.438360 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:32.438366 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:32.438406 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:32.438553 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:32.439225 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:32.439229 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:32.439229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:32.439233 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:32.439300 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:32.439314 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:32.439400 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:32.439441 (+ 41us) server_negotiation.cc:299] Negotiation successful
0929 06:34:32.439494 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":72,"threads_started":1}
I20260929 06:34:32.440237 19217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884: No bootstrap required, opened a new log
I20260929 06:34:32.441569 19217 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa6d91bb7f154feea5bc711b9f66b884" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38139 } }
I20260929 06:34:32.441725 19217 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:32.441772 19217 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa6d91bb7f154feea5bc711b9f66b884, State: Initialized, Role: FOLLOWER
I20260929 06:34:32.441911 19217 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa6d91bb7f154feea5bc711b9f66b884" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38139 } }
I20260929 06:34:32.442001 19217 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:32.442044 19217 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:32.442088 19217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:32.442843 19217 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa6d91bb7f154feea5bc711b9f66b884" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38139 } }
I20260929 06:34:32.442961 19217 leader_election.cc:302] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa6d91bb7f154feea5bc711b9f66b884; no voters:
I20260929 06:34:32.443135 19217 leader_election.cc:288] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:32.443187 19222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:32.443339 19222 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [term 1 LEADER]: Becoming Leader. State: Replica: fa6d91bb7f154feea5bc711b9f66b884, State: Running, Role: LEADER
I20260929 06:34:32.443392 19217 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:32.443434 19222 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa6d91bb7f154feea5bc711b9f66b884" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38139 } }
I20260929 06:34:32.443876 19223 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa6d91bb7f154feea5bc711b9f66b884" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa6d91bb7f154feea5bc711b9f66b884" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38139 } } }
I20260929 06:34:32.443871 19224 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa6d91bb7f154feea5bc711b9f66b884. Latest consensus state: current_term: 1 leader_uuid: "fa6d91bb7f154feea5bc711b9f66b884" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa6d91bb7f154feea5bc711b9f66b884" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38139 } } }
I20260929 06:34:32.444006 19223 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:32.444010 19224 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884 [sys.catalog]: This master's current role is: LEADER
W20260929 06:34:32.445199 19238 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:34:32.445261 19238 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:34:32.445472 19231 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:32.445647 19231 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:32.447068 19231 catalog_manager.cc:1347] Generated new cluster ID: dc9f6f0745794a7dbe962d8e0af2546e
I20260929 06:34:32.447136 19231 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:34:32.466224 19231 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:32.466406 19231 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:32.470785 19231 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa6d91bb7f154feea5bc711b9f66b884: Generated new TSK 0
I20260929 06:34:32.470958 19231 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:34:32.482507 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38139
--builtin_ntp_servers=127.9.61.84:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 06:34:32.561779 19241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:32.562006 19241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:32.562042 19241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:32.563210 19241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:32.563277 19241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:32.563318 19241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:34:32.564658 19241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:32.564924 19241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:32.565217 19241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:32.570120 19247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:32.570096 19246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:32.570277 19241 server_base.cc:1034] running on GCE node
W20260929 06:34:32.570362 19249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:32.570596 19241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:32.570842 19241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:32.571995 19241 hybrid_clock.cc:648] HybridClock initialized: now 1790663672571986 us; error 40 us; skew 500 ppm
I20260929 06:34:32.573202 19241 webserver.cc:460] Webserver started at http://127.9.61.65:34863/ using document root <none> and password file <none>
I20260929 06:34:32.573457 19241 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:32.573526 19241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:32.573690 19241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:32.574748 19241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "a3bb3987ff75428babb6c0a5963b4811"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "c630618ea57d7b38880dc4bd44183016"
server_key_iv: "2cb9605a5e5ff34a4d610aa9bf34d911"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.575106 19241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "a3bb3987ff75428babb6c0a5963b4811"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "c630618ea57d7b38880dc4bd44183016"
server_key_iv: "2cb9605a5e5ff34a4d610aa9bf34d911"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.576453 19241 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:34:32.577160 19255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.577332 19241 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:34:32.577428 19241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "a3bb3987ff75428babb6c0a5963b4811"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "c630618ea57d7b38880dc4bd44183016"
server_key_iv: "2cb9605a5e5ff34a4d610aa9bf34d911"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.577505 19241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:32.580823 19241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:32.581086 19241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:32.581230 19241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:32.581451 19241 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:32.581759 19241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:32.581813 19241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.581851 19241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:32.581879 19241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.587255 19241 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:39019
I20260929 06:34:32.587320 19368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:39019 every 8 connection(s)
I20260929 06:34:32.587639 19241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:34:32.590561 19220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.588521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:40275 (local address 127.9.61.126:38139)
0929 06:34:32.588586 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:32.588588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:32.588804 (+ 216us) server_negotiation.cc:407] Connection header received
0929 06:34:32.589235 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:32.589236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:32.589241 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:32.589302 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:32.590383 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:32.590384 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:32.590384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:32.590388 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:32.590402 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:32.590407 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:32.590452 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:32.590496 (+ 44us) server_negotiation.cc:299] Negotiation successful
0929 06:34:32.590509 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:34:32.590737 19371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.588503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38139 (local address 127.9.61.65:40275)
0929 06:34:32.588673 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:32.588712 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:32.589148 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:32.589352 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:32.589356 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:32.589364 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:32.590244 (+ 880us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:32.590244 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:32.590271 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:32.590298 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:32.590450 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:32.590452 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:32.590454 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:34:32.590503 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 06:34:32.590547 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":80,"threads_started":1}
I20260929 06:34:32.591231 19369 heartbeater.cc:347] Connected to a master server at 127.9.61.126:38139
I20260929 06:34:32.591316 19369 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:32.591428 19369 heartbeater.cc:511] Master 127.9.61.126:38139 requested a full tablet report, sending...
I20260929 06:34:32.591903 19181 ts_manager.cc:194] Registered new tserver with Master: a3bb3987ff75428babb6c0a5963b4811 (127.9.61.65:39019)
I20260929 06:34:32.597347 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 19241
I20260929 06:34:32.597426 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:34:32.597579 9461 external_mini_cluster.cc:1428] Setting key ec1a4ba48f575112a227ee976e321a3c
I20260929 06:34:32.598449 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38139
--builtin_ntp_servers=127.9.61.84:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260929 06:34:32.677336 19372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:32.677525 19372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:32.677547 19372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:32.678597 19372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:32.678630 19372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:32.678655 19372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:34:32.679997 19372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:32.680172 19372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:32.680397 19372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:34:32.685287 19372 server_base.cc:1034] running on GCE node
W20260929 06:34:32.685253 19378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:32.685262 19377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:32.685262 19380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:32.685732 19372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:32.685982 19372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:32.687139 19372 hybrid_clock.cc:648] HybridClock initialized: now 1790663672687127 us; error 44 us; skew 500 ppm
I20260929 06:34:32.688486 19372 webserver.cc:460] Webserver started at http://127.9.61.66:45141/ using document root <none> and password file <none>
I20260929 06:34:32.688756 19372 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:32.688828 19372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:32.688974 19372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:32.690047 19372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "40e85908bf314e339280efe1f7e0f9be"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "20c2709356a3dd3dbd3cc1d43361697e"
server_key_iv: "dc1a1dd243fb5e302a847dcb4bfa166e"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.690438 19372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "40e85908bf314e339280efe1f7e0f9be"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "20c2709356a3dd3dbd3cc1d43361697e"
server_key_iv: "dc1a1dd243fb5e302a847dcb4bfa166e"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.691670 19372 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:34:32.692410 19386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.692569 19372 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.692654 19372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "40e85908bf314e339280efe1f7e0f9be"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "20c2709356a3dd3dbd3cc1d43361697e"
server_key_iv: "dc1a1dd243fb5e302a847dcb4bfa166e"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.692708 19372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:32.695864 19372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:32.696120 19372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:32.696224 19372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:32.696389 19372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:32.696617 19372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:32.696650 19372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.696668 19372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:32.696704 19372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.701979 19372 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:43647
I20260929 06:34:32.702054 19499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:43647 every 8 connection(s)
I20260929 06:34:32.702410 19372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:34:32.702725 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 19372
I20260929 06:34:32.702828 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:34:32.703038 9461 external_mini_cluster.cc:1428] Setting key 0ae85ab97c89f7179716ebfe194b4354
I20260929 06:34:32.704072 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38139
--builtin_ntp_servers=127.9.61.84:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260929 06:34:32.705715 19220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.703284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:50073 (local address 127.9.61.126:38139)
0929 06:34:32.703456 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:32.703460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:32.703555 (+ 95us) server_negotiation.cc:407] Connection header received
0929 06:34:32.704200 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:32.704202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:32.704209 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:32.704269 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:32.705453 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:32.705454 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:32.705455 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:32.705459 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:32.705479 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:32.705484 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:32.705555 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:32.705602 (+ 47us) server_negotiation.cc:299] Negotiation successful
0929 06:34:32.705617 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260929 06:34:32.705842 19502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.703210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38139 (local address 127.9.61.66:50073)
0929 06:34:32.703446 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:32.703487 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:32.704073 (+ 586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:32.704336 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:32.704339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:32.704348 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:32.705307 (+ 959us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:32.705308 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:32.705335 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:32.705361 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:32.705554 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:32.705556 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:32.705558 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:34:32.705607 (+ 49us) client_negotiation.cc:240] Negotiation successful
0929 06:34:32.705650 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":115,"threads_started":1}
I20260929 06:34:32.706251 19500 heartbeater.cc:347] Connected to a master server at 127.9.61.126:38139
I20260929 06:34:32.706367 19500 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:32.706517 19500 heartbeater.cc:511] Master 127.9.61.126:38139 requested a full tablet report, sending...
I20260929 06:34:32.706899 19181 ts_manager.cc:194] Registered new tserver with Master: 40e85908bf314e339280efe1f7e0f9be (127.9.61.66:43647)
W20260929 06:34:32.784216 19503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:32.784417 19503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:32.784441 19503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:32.785532 19503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:32.785565 19503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:32.785590 19503 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:34:32.786849 19503 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:32.787029 19503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:32.787261 19503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:32.792162 19509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:32.792160 19508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:32.792165 19511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:32.792465 19503 server_base.cc:1034] running on GCE node
I20260929 06:34:32.792685 19503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:32.792927 19503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:32.794087 19503 hybrid_clock.cc:648] HybridClock initialized: now 1790663672794065 us; error 34 us; skew 500 ppm
I20260929 06:34:32.795393 19503 webserver.cc:460] Webserver started at http://127.9.61.67:41755/ using document root <none> and password file <none>
I20260929 06:34:32.795655 19503 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:32.795730 19503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:32.795890 19503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:32.797019 19503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "0b98ef5494ed4f3fa1a4d900b27f9c4d"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "65f1f7ded500d377cf08f4aca62c96ae"
server_key_iv: "c387b41b4e497c64bf83b9eed7004a53"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.797374 19503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "0b98ef5494ed4f3fa1a4d900b27f9c4d"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "65f1f7ded500d377cf08f4aca62c96ae"
server_key_iv: "c387b41b4e497c64bf83b9eed7004a53"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.798655 19503 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:34:32.799364 19517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.799530 19503 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:32.799625 19503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "0b98ef5494ed4f3fa1a4d900b27f9c4d"
format_stamp: "Formatted at 2026-09-29 06:34:32 on dist-test-slave-601b"
server_key: "65f1f7ded500d377cf08f4aca62c96ae"
server_key_iv: "c387b41b4e497c64bf83b9eed7004a53"
server_key_version: "encryptionkey@0"
I20260929 06:34:32.799706 19503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:32.802989 19503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:32.803267 19503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:32.803403 19503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:32.803614 19503 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:32.803913 19503 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:32.803980 19503 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.804015 19503 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:32.804041 19503 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:32.809742 19503 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:44659
I20260929 06:34:32.809813 19630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:44659 every 8 connection(s)
I20260929 06:34:32.810119 19503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:34:32.813146 19220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.810856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:48643 (local address 127.9.61.126:38139)
0929 06:34:32.810913 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:32.810915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:32.811133 (+ 218us) server_negotiation.cc:407] Connection header received
0929 06:34:32.811638 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:32.811639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:32.811646 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:32.811730 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:32.812907 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:32.812909 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:32.812909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:34:32.812914 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:32.812931 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:34:32.812935 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:32.812986 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:32.813061 (+ 75us) server_negotiation.cc:299] Negotiation successful
0929 06:34:32.813075 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 06:34:32.813349 19633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:32.810838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38139 (local address 127.9.61.67:48643)
0929 06:34:32.811019 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:32.811051 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:32.811526 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:32.811811 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:32.811814 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:32.811822 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:32.812758 (+ 936us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:34:32.812759 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:32.812787 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:34:32.812814 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:32.812983 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:32.812988 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:32.812992 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:32.813068 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 06:34:32.813128 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":78,"threads_started":1}
I20260929 06:34:32.813831 19631 heartbeater.cc:347] Connected to a master server at 127.9.61.126:38139
I20260929 06:34:32.813905 19631 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:32.814066 19631 heartbeater.cc:511] Master 127.9.61.126:38139 requested a full tablet report, sending...
I20260929 06:34:32.814435 19181 ts_manager.cc:194] Registered new tserver with Master: 0b98ef5494ed4f3fa1a4d900b27f9c4d (127.9.61.67:44659)
I20260929 06:34:32.819366 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 19503
I20260929 06:34:32.819448 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:34:32.819648 9461 external_mini_cluster.cc:1428] Setting key 4fdbddf4ff2af95de522de868c06bc84
I20260929 06:34:32.820538 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260929 06:34:32.822238 19220 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:34:32.821792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50994 (local address 127.9.61.126:38139)
0929 06:34:32.821827 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:32.821829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:32.821937 (+ 108us) server_negotiation.cc:407] Connection header received
0929 06:34:32.821997 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:32.821998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:32.822002 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:32.822050 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:32.822158 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50994: BlockingRecv error: recv got EOF from 127.0.0.1:50994 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:34:32.822366 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 19241
I20260929 06:34:32.827024 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 19372
I20260929 06:34:32.831149 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 19503
I20260929 06:34:32.835119 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 19150
2026-09-29T06:34:32Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (527 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:34:32 dist-test-slave-601b krb5kdc[19641](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:34:32 dist-test-slave-601b krb5kdc[19641](info): set up 2 sockets
Sep 29 06:34:32 dist-test-slave-601b krb5kdc[19641](info): commencing operation
krb5kdc: starting...
W20260929 06:34:33.860822 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:34:33 dist-test-slave-601b krb5kdc[19641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:34:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:34:33.982692 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:34769
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:34769
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:34.064337 19654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:34.064546 19654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:34.064567 19654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:34.065745 19654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:34:34.065784 19654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:34.065798 19654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:34.065809 19654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:34:34.065821 19654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:34:34.067266 19654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:34769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:34769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:34.067523 19654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:34.067749 19654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:34.072552 19662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:34.072562 19659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:34.072707 19654 server_base.cc:1034] running on GCE node
W20260929 06:34:34.072824 19660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:34.073066 19654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:34.073387 19654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:34.074527 19654 hybrid_clock.cc:648] HybridClock initialized: now 1790663674074509 us; error 39 us; skew 500 ppm
Sep 29 06:34:34 dist-test-slave-601b krb5kdc[19641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663674, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:34.080255 19654 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:34:34.080745 19654 webserver.cc:460] Webserver started at http://127.9.61.126:46353/ using document root <none> and password file <none>
I20260929 06:34:34.080978 19654 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:34.081022 19654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:34.081180 19654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:34.082235 19654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "ce5fb873c25d48f69b4237f43f07928a"
format_stamp: "Formatted at 2026-09-29 06:34:34 on dist-test-slave-601b"
server_key: "3856f89c879c2a0dd3000dd05acc7364"
server_key_iv: "839b056d1c77ec5949d4def3cf74fead"
server_key_version: "encryptionkey@0"
I20260929 06:34:34.082669 19654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "ce5fb873c25d48f69b4237f43f07928a"
format_stamp: "Formatted at 2026-09-29 06:34:34 on dist-test-slave-601b"
server_key: "3856f89c879c2a0dd3000dd05acc7364"
server_key_iv: "839b056d1c77ec5949d4def3cf74fead"
server_key_version: "encryptionkey@0"
I20260929 06:34:34.083923 19654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:34:34.084659 19669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:34.084867 19654 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:34.084937 19654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "ce5fb873c25d48f69b4237f43f07928a"
format_stamp: "Formatted at 2026-09-29 06:34:34 on dist-test-slave-601b"
server_key: "3856f89c879c2a0dd3000dd05acc7364"
server_key_iv: "839b056d1c77ec5949d4def3cf74fead"
server_key_version: "encryptionkey@0"
I20260929 06:34:34.085028 19654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:34.107524 19654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:34.109982 19654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:34.110139 19654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:34.114225 19654 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:34769
I20260929 06:34:34.114262 19721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:34769 every 8 connection(s)
I20260929 06:34:34.114698 19654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:34:34.115902 19722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:34.117257 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 19654
I20260929 06:34:34.117364 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:34:34.117558 9461 external_mini_cluster.cc:1428] Setting key 127cd2b6adb60027f92a27fa70e6594e
I20260929 06:34:34.118726 19722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a: Bootstrap starting.
I20260929 06:34:34.119462 19722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:34.119792 19722 log.cc:824] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:34.120510 19722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a: No bootstrap required, opened a new log
I20260929 06:34:34.122829 19722 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5fb873c25d48f69b4237f43f07928a" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 34769 } }
I20260929 06:34:34.123008 19722 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:34.123049 19722 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce5fb873c25d48f69b4237f43f07928a, State: Initialized, Role: FOLLOWER
I20260929 06:34:34.123189 19722 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5fb873c25d48f69b4237f43f07928a" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 34769 } }
I20260929 06:34:34.123292 19722 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:34:34.123328 19722 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:34:34.123385 19722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:34.124141 19722 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5fb873c25d48f69b4237f43f07928a" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 34769 } }
I20260929 06:34:34.124236 19722 leader_election.cc:302] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce5fb873c25d48f69b4237f43f07928a; no voters:
I20260929 06:34:34.124451 19722 leader_election.cc:288] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:34:34.124500 19727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [term 1 FOLLOWER]: Leader election won for term 1
Sep 29 06:34:34 dist-test-slave-601b krb5kdc[19641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:34.124661 19727 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [term 1 LEADER]: Becoming Leader. State: Replica: ce5fb873c25d48f69b4237f43f07928a, State: Running, Role: LEADER
I20260929 06:34:34.124719 19722 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:34:34.124752 19727 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5fb873c25d48f69b4237f43f07928a" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 34769 } }
I20260929 06:34:34.125043 19727 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce5fb873c25d48f69b4237f43f07928a. Latest consensus state: current_term: 1 leader_uuid: "ce5fb873c25d48f69b4237f43f07928a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5fb873c25d48f69b4237f43f07928a" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 34769 } } }
I20260929 06:34:34.125133 19727 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [sys.catalog]: This master's current role is: LEADER
I20260929 06:34:34.125051 19728 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce5fb873c25d48f69b4237f43f07928a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5fb873c25d48f69b4237f43f07928a" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 34769 } } }
I20260929 06:34:34.125322 19728 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a [sys.catalog]: This master's current role is: LEADER
W20260929 06:34:34.126780 19742 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:34:34.126837 19742 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:34:34.126880 19733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:34:34.127017 19733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:34:34.128959 19725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.118087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57774 (local address 127.9.61.126:34769)
0929 06:34:34.118284 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:34.118293 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:34.118324 (+ 31us) server_negotiation.cc:407] Connection header received
0929 06:34:34.118750 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:34.118757 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:34.118836 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:34.118960 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:34.119736 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.120875 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.121921 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.122303 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.122380 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.125249 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:34.125253 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:34.125253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:34.125264 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:34.127185 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:34.127553 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:34.127556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:34.127556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:34.127650 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:34.127880 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:34.127881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:34.127881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:34.128210 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:34.128354 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:34.128583 (+ 229us) server_negotiation.cc:299] Negotiation successful
0929 06:34:34.128730 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":104,"threads_started":1}
I20260929 06:34:34.129047 19733 catalog_manager.cc:1347] Generated new cluster ID: 97e3288a94174364bbe1c1e0f4d55d2b
I20260929 06:34:34.129091 19733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:34:34.139400 19733 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:34:34.139997 19733 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:34:34.147740 19733 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a: Generated new TSK 0
I20260929 06:34:34.147989 19733 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:34:34.176726 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:34769
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:34.288869 19748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:34.289085 19748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:34.289113 19748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:34.290343 19748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:34.290388 19748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:34.290417 19748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:34:34.292094 19748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:34769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:34.292388 19748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:34.292651 19748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:34.297760 19754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:34.297770 19756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:34.297812 19753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:34.297825 19748 server_base.cc:1034] running on GCE node
I20260929 06:34:34.298110 19748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:34.298391 19748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:34.299576 19748 hybrid_clock.cc:648] HybridClock initialized: now 1790663674299572 us; error 41 us; skew 500 ppm
Sep 29 06:34:34 dist-test-slave-601b krb5kdc[19641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663674, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:34.302309 19748 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:34:34.302788 19748 webserver.cc:460] Webserver started at http://127.9.61.65:44661/ using document root <none> and password file <none>
I20260929 06:34:34.303031 19748 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:34.303102 19748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:34.303261 19748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:34.304445 19748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93"
format_stamp: "Formatted at 2026-09-29 06:34:34 on dist-test-slave-601b"
server_key: "dda6bdec4415463e32e1dcf6802aaefd"
server_key_iv: "af615948289696a8d727c8505842d34d"
server_key_version: "encryptionkey@0"
I20260929 06:34:34.304822 19748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93"
format_stamp: "Formatted at 2026-09-29 06:34:34 on dist-test-slave-601b"
server_key: "dda6bdec4415463e32e1dcf6802aaefd"
server_key_iv: "af615948289696a8d727c8505842d34d"
server_key_version: "encryptionkey@0"
I20260929 06:34:34.306181 19748 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:34:34.306937 19763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:34.307108 19748 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:34:34.307210 19748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93"
format_stamp: "Formatted at 2026-09-29 06:34:34 on dist-test-slave-601b"
server_key: "dda6bdec4415463e32e1dcf6802aaefd"
server_key_iv: "af615948289696a8d727c8505842d34d"
server_key_version: "encryptionkey@0"
I20260929 06:34:34.307296 19748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:34.315371 19748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:34.317850 19748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:34.318022 19748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:34.318269 19748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:34.318588 19748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:34.318645 19748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:34.318691 19748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:34.318722 19748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:34.324616 19748 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:34151
I20260929 06:34:34.324708 19876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:34151 every 8 connection(s)
I20260929 06:34:34.325066 19748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:34:34 dist-test-slave-601b krb5kdc[19641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663674, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:34.332150 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 19748
I20260929 06:34:34.332237 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:34:34.332440 9461 external_mini_cluster.cc:1428] Setting key f78c97c66e3f6c1418cbf6dcaa0084d7
I20260929 06:34:34.335100 19725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.325912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:37497 (local address 127.9.61.126:34769)
0929 06:34:34.325975 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:34.325978 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:34.326259 (+ 281us) server_negotiation.cc:407] Connection header received
0929 06:34:34.326833 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:34.326834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:34.326844 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:34.326898 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:34.327829 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.328416 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.329383 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.329577 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.329628 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.331827 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:34.331829 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:34.331829 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:34.331836 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:34.333462 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:34.333985 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:34.333986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:34.333987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:34.334042 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:34.334327 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:34.334328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:34.334328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:34.334483 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:34.334562 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:34.334873 (+ 311us) server_negotiation.cc:299] Negotiation successful
0929 06:34:34.334977 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 06:34:34.335124 19879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.325946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:34769 (local address 127.9.61.65:37497)
0929 06:34:34.326120 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:34.326157 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:34.326738 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:34.326956 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:34.326959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:34.327543 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:34.327748 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.327752 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.328499 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.328499 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.329302 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.329304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.329649 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.329650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.329751 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.330321 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:34.330330 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:34.331736 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:34.333547 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:34.333554 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:34.333557 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:34.333902 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:34.334103 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:34.334104 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:34.334104 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:34.334264 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:34.334563 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:34.334569 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:34.334734 (+ 165us) client_negotiation.cc:769] Sending connection context
0929 06:34:34.334825 (+ 91us) client_negotiation.cc:240] Negotiation successful
0929 06:34:34.334953 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":92,"threads_started":1}
I20260929 06:34:34.335654 19877 heartbeater.cc:347] Connected to a master server at 127.9.61.126:34769
I20260929 06:34:34.335772 19877 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:34.336028 19877 heartbeater.cc:511] Master 127.9.61.126:34769 requested a full tablet report, sending...
I20260929 06:34:34.336557 19686 ts_manager.cc:194] Registered new tserver with Master: a2fb3b3ffa404516a1b1c41c0fb3ce93 (127.9.61.65:34151)
I20260929 06:34:34.337201 19686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:37497
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:34:34.359875 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:34769
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:34.443441 19882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:34.443660 19882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:34.443688 19882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:34.444939 19882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:34.444984 19882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:34.445012 19882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:34:34.446413 19882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:34769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:34.446604 19882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:34.446789 19882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:34.451745 19890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:34.451735 19888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:34.451735 19887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:34.451810 19882 server_base.cc:1034] running on GCE node
I20260929 06:34:34.452188 19882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:34.452435 19882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:34.453581 19882 hybrid_clock.cc:648] HybridClock initialized: now 1790663674453561 us; error 43 us; skew 500 ppm
Sep 29 06:34:34 dist-test-slave-601b krb5kdc[19641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663674, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:34.456247 19882 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:34:34.456665 19882 webserver.cc:460] Webserver started at http://127.9.61.66:36811/ using document root <none> and password file <none>
I20260929 06:34:34.456898 19882 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:34.456943 19882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:34.457039 19882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:34.458101 19882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "4523585f14034619956b6f45e87c018d"
format_stamp: "Formatted at 2026-09-29 06:34:34 on dist-test-slave-601b"
server_key: "54bac6c6aacf80941264c76f3265856a"
server_key_iv: "cc527a1900ae72aed77b3883a9f0d669"
server_key_version: "encryptionkey@0"
I20260929 06:34:34.458424 19882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "4523585f14034619956b6f45e87c018d"
format_stamp: "Formatted at 2026-09-29 06:34:34 on dist-test-slave-601b"
server_key: "54bac6c6aacf80941264c76f3265856a"
server_key_iv: "cc527a1900ae72aed77b3883a9f0d669"
server_key_version: "encryptionkey@0"
I20260929 06:34:34.459715 19882 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260929 06:34:34.460536 19897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:34.460711 19882 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:34.460798 19882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "4523585f14034619956b6f45e87c018d"
format_stamp: "Formatted at 2026-09-29 06:34:34 on dist-test-slave-601b"
server_key: "54bac6c6aacf80941264c76f3265856a"
server_key_iv: "cc527a1900ae72aed77b3883a9f0d669"
server_key_version: "encryptionkey@0"
I20260929 06:34:34.460855 19882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:34.470100 19882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:34.472451 19882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:34.472572 19882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:34.472777 19882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:34.473033 19882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:34.473062 19882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:34.473085 19882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:34.473097 19882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:34.478826 19882 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:46257
I20260929 06:34:34.478909 20010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:46257 every 8 connection(s)
I20260929 06:34:34.479254 19882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:34:34.485108 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 19882
I20260929 06:34:34.485229 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:34:34.485430 9461 external_mini_cluster.cc:1428] Setting key 7e90ecec80e5aabe384eed45184faf40
Sep 29 06:34:34 dist-test-slave-601b krb5kdc[19641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663674, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:34.489624 19725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.480090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:43733 (local address 127.9.61.126:34769)
0929 06:34:34.480164 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:34.480166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:34.480400 (+ 234us) server_negotiation.cc:407] Connection header received
0929 06:34:34.481002 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:34.481003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:34.481015 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:34.481074 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:34.482093 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.482604 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.483642 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.483838 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.483924 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.486354 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:34.486356 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:34.486356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:34.486364 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:34.488092 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:34.488592 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:34.488593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:34.488594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:34.488648 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:34.488952 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:34.488952 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:34.488953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:34.489058 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:34.489116 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:34.489474 (+ 358us) server_negotiation.cc:299] Negotiation successful
0929 06:34:34.489557 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260929 06:34:34.489920 20013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.480075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:34769 (local address 127.9.61.66:43733)
0929 06:34:34.480267 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:34.480305 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:34.480883 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:34.481153 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:34.481157 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:34.481776 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:34.481978 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.481983 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.482714 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.482715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.483526 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.483527 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.483933 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.483934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.484088 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.484572 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:34.484581 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:34.486252 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:34.488167 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:34.488174 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:34.488177 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:34.488516 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:34.488726 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:34.488727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:34.488728 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:34.488884 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:34.489124 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:34.489131 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:34.489321 (+ 190us) client_negotiation.cc:769] Sending connection context
0929 06:34:34.489442 (+ 121us) client_negotiation.cc:240] Negotiation successful
0929 06:34:34.489632 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":89,"threads_started":1}
I20260929 06:34:34.490425 20011 heartbeater.cc:347] Connected to a master server at 127.9.61.126:34769
I20260929 06:34:34.490548 20011 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:34.490761 20011 heartbeater.cc:511] Master 127.9.61.126:34769 requested a full tablet report, sending...
I20260929 06:34:34.491190 19686 ts_manager.cc:194] Registered new tserver with Master: 4523585f14034619956b6f45e87c018d (127.9.61.66:46257)
I20260929 06:34:34.491565 19686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:43733
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:34:34.514679 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:34769
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:34:34.597945 20016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:34:34.598177 20016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:34:34.598204 20016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:34:34.599367 20016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:34:34.599409 20016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:34:34.599437 20016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:34:34.601024 20016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:34769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:34:34.601238 20016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:34:34.601428 20016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:34:34.606781 20022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:34:34.606750 20021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:34.606871 20016 server_base.cc:1034] running on GCE node
W20260929 06:34:34.606751 20024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:34:34.607173 20016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:34:34.607395 20016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:34:34.608534 20016 hybrid_clock.cc:648] HybridClock initialized: now 1790663674608523 us; error 32 us; skew 500 ppm
Sep 29 06:34:34 dist-test-slave-601b krb5kdc[19641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663674, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:34:34.611253 20016 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:34:34.611763 20016 webserver.cc:460] Webserver started at http://127.9.61.67:45673/ using document root <none> and password file <none>
I20260929 06:34:34.612074 20016 fs_manager.cc:359] Metadata directory not provided
I20260929 06:34:34.612145 20016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:34:34.612298 20016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:34:34.613372 20016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "39fd47d32c7741b38812cbc55d89dc4d"
format_stamp: "Formatted at 2026-09-29 06:34:34 on dist-test-slave-601b"
server_key: "f02acda24e23e74ae49657478d24e7ed"
server_key_iv: "9b08e3c158c9fd06d35ac078259a3eb2"
server_key_version: "encryptionkey@0"
I20260929 06:34:34.613741 20016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "39fd47d32c7741b38812cbc55d89dc4d"
format_stamp: "Formatted at 2026-09-29 06:34:34 on dist-test-slave-601b"
server_key: "f02acda24e23e74ae49657478d24e7ed"
server_key_iv: "9b08e3c158c9fd06d35ac078259a3eb2"
server_key_version: "encryptionkey@0"
I20260929 06:34:34.615088 20016 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:34:34.615851 20031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:34.616050 20016 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:34:34.616151 20016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "39fd47d32c7741b38812cbc55d89dc4d"
format_stamp: "Formatted at 2026-09-29 06:34:34 on dist-test-slave-601b"
server_key: "f02acda24e23e74ae49657478d24e7ed"
server_key_iv: "9b08e3c158c9fd06d35ac078259a3eb2"
server_key_version: "encryptionkey@0"
I20260929 06:34:34.616240 20016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:34:34.624871 20016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:34:34.627291 20016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:34:34.627461 20016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:34:34.627692 20016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:34:34.628057 20016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:34:34.628093 20016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:34.628132 20016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:34:34.628171 20016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:34:34.633906 20016 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:34299
I20260929 06:34:34.633983 20144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:34299 every 8 connection(s)
I20260929 06:34:34.634328 20016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:34:34.639899 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 20016
I20260929 06:34:34.640028 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:34:34.640220 9461 external_mini_cluster.cc:1428] Setting key da00e7886409cd60cebc7d6da70ecdc7
Sep 29 06:34:34 dist-test-slave-601b krb5kdc[19641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663674, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:34:34.643909 19725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.635109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:39895 (local address 127.9.61.126:34769)
0929 06:34:34.635177 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:34.635179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:34.635397 (+ 218us) server_negotiation.cc:407] Connection header received
0929 06:34:34.635885 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:34.635886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:34.635895 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:34.636016 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:34.637020 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.637511 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.638491 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.638689 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.638741 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.641149 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:34.641151 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:34.641151 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:34.641159 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:34.642730 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:34.643098 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:34.643099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:34.643099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:34.643151 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:34.643359 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:34.643359 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:34.643360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:34.643464 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:34.643522 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:34.643781 (+ 259us) server_negotiation.cc:299] Negotiation successful
0929 06:34:34.643843 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:34:34.644150 20147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.635076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:34769 (local address 127.9.61.67:39895)
0929 06:34:34.635265 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:34.635307 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:34.635803 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:34.636086 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:34.636090 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:34.636725 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:34:34.636931 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.636936 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.637597 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.637598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.638411 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.638413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.638764 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.638764 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.638870 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.639359 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:34:34.639367 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:34:34.641052 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:34:34.642805 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:34.642811 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:34.642813 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:34.643031 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:34.643209 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:34:34.643210 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:34:34.643210 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:34:34.643305 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:34:34.643529 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:34:34.643533 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:34:34.643666 (+ 133us) client_negotiation.cc:769] Sending connection context
0929 06:34:34.643750 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 06:34:34.643872 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":104,"threads_started":1}
I20260929 06:34:34.644608 20145 heartbeater.cc:347] Connected to a master server at 127.9.61.126:34769
I20260929 06:34:34.644721 20145 heartbeater.cc:464] Registering TS with master...
I20260929 06:34:34.644919 20145 heartbeater.cc:511] Master 127.9.61.126:34769 requested a full tablet report, sending...
I20260929 06:34:34.645285 19686 ts_manager.cc:194] Registered new tserver with Master: 39fd47d32c7741b38812cbc55d89dc4d (127.9.61.67:34299)
I20260929 06:34:34.645736 19686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:39895
I20260929 06:34:34.651897 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:34:34.659463 19725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.653235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57784 (local address 127.9.61.126:34769)
0929 06:34:34.653283 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:34.653284 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:34.653364 (+ 80us) server_negotiation.cc:407] Connection header received
0929 06:34:34.653420 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:34.653420 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:34.653429 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:34.653479 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:34:34.654051 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.654558 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.655832 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.656077 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.656130 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.657272 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:34:34.657273 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:34:34.657273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:34:34.657279 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:34:34.658479 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:34.658783 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:34.658784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:34.658785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:34.658851 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:34:34.659019 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:34:34.659020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:34:34.659020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:34:34.659169 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:34:34.659245 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:34.659338 (+ 93us) server_negotiation.cc:299] Negotiation successful
0929 06:34:34.659395 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:34:34.661078 19686 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:34:34.662699 19686 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:34:34.669401 20158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.665121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:46257 (local address 127.0.0.1:40538)
0929 06:34:34.665281 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:34.665293 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:34.665337 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:34.665947 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:34.665948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:34.665950 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:34.666008 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.666011 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.666966 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.666967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.668319 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.668322 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.669084 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.669085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.669165 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.669181 (+ 16us) client_negotiation.cc:769] Sending connection context
0929 06:34:34.669254 (+ 73us) client_negotiation.cc:240] Negotiation successful
0929 06:34:34.669313 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":59,"thread_start_us":95,"threads_started":1}
I20260929 06:34:34.669606 20156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.665119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:34299 (local address 127.0.0.1:47190)
0929 06:34:34.665226 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:34.665268 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:34.665338 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:34.665709 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:34.665712 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:34.665715 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:34.665788 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.665790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.667191 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.667192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.668311 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.668313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.669219 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.669220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.669279 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.669282 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:34:34.669349 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 06:34:34.669382 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81,"mutex_wait_us":62,"thread_start_us":63,"threads_started":1}
I20260929 06:34:34.669673 20161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.665596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40538 (local address 127.9.61.66:46257)
0929 06:34:34.665763 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:34.665769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:34.665780 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:34:34.665824 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:34.665827 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:34.665844 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:34.666094 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:34.666162 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.666861 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.668415 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.668982 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.669068 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.669134 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:34.669552 (+ 418us) server_negotiation.cc:299] Negotiation successful
0929 06:34:34.669602 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
I20260929 06:34:34.669700 20157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.665121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:34151 (local address 127.0.0.1:40434)
0929 06:34:34.665775 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:34.665810 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:34.665871 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:34.666157 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:34.666158 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:34.666160 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:34.666203 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.666204 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.667447 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.667448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.668518 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.668519 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.669454 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.669455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.669532 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.669537 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:34:34.669584 (+ 47us) client_negotiation.cc:240] Negotiation successful
0929 06:34:34.669627 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"mutex_wait_us":9,"thread_start_us":80,"threads_started":1}
I20260929 06:34:34.669894 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.665366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40434 (local address 127.9.61.65:34151)
0929 06:34:34.665531 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:34.665536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:34.665932 (+ 396us) server_negotiation.cc:407] Connection header received
0929 06:34:34.665973 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:34.665976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:34.665991 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:34.666076 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:34.666285 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.667350 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.668596 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.669308 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.669371 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.669420 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:34.669796 (+ 376us) server_negotiation.cc:299] Negotiation successful
0929 06:34:34.669839 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
I20260929 06:34:34.670421 19945 tablet_service.cc:1467] Processing CreateTablet for tablet 31620032d39f41e79b178f5dc077c799 (DEFAULT_TABLE table=test-table [id=ea26bcf7bce945d2b9e8e1bec2b6e1a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:34.670576 20160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.665370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47190 (local address 127.9.61.67:34299)
0929 06:34:34.665531 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:34.665536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:34.665546 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:34:34.665585 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:34.665587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:34.665602 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:34.665702 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:34.665878 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.667069 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.668396 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.669082 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.669192 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.669248 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:34.669448 (+ 200us) server_negotiation.cc:299] Negotiation successful
0929 06:34:34.670488 (+ 1040us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":83,"threads_started":1}
I20260929 06:34:34.670559 19811 tablet_service.cc:1467] Processing CreateTablet for tablet 31620032d39f41e79b178f5dc077c799 (DEFAULT_TABLE table=test-table [id=ea26bcf7bce945d2b9e8e1bec2b6e1a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:34.670818 19945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31620032d39f41e79b178f5dc077c799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:34.670871 19811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31620032d39f41e79b178f5dc077c799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:34.671271 20079 tablet_service.cc:1467] Processing CreateTablet for tablet 31620032d39f41e79b178f5dc077c799 (DEFAULT_TABLE table=test-table [id=ea26bcf7bce945d2b9e8e1bec2b6e1a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:34:34.671569 20079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31620032d39f41e79b178f5dc077c799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:34:34.673718 20162 tablet_bootstrap.cc:492] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d: Bootstrap starting.
I20260929 06:34:34.674194 20163 tablet_bootstrap.cc:492] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93: Bootstrap starting.
I20260929 06:34:34.674487 20162 tablet_bootstrap.cc:654] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:34.674839 20163 tablet_bootstrap.cc:654] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:34.675009 20164 tablet_bootstrap.cc:492] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d: Bootstrap starting.
I20260929 06:34:34.675081 20162 log.cc:824] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:34.675401 20163 log.cc:824] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:34.675650 20164 tablet_bootstrap.cc:654] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d: Neither blocks nor log segments found. Creating new log.
I20260929 06:34:34.675992 20162 tablet_bootstrap.cc:492] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d: No bootstrap required, opened a new log
I20260929 06:34:34.676067 20162 ts_tablet_manager.cc:1397] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:34:34.676270 20164 log.cc:824] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d: Log is configured to *not* fsync() on all Append() calls
I20260929 06:34:34.676546 20163 tablet_bootstrap.cc:492] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93: No bootstrap required, opened a new log
I20260929 06:34:34.676615 20163 ts_tablet_manager.cc:1397] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:34:34.677013 20164 tablet_bootstrap.cc:492] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d: No bootstrap required, opened a new log
I20260929 06:34:34.677085 20164 ts_tablet_manager.cc:1397] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:34:34.677793 20162 raft_consensus.cc:348] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523585f14034619956b6f45e87c018d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 46257 } } peers { permanent_uuid: "39fd47d32c7741b38812cbc55d89dc4d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 34299 } } peers { permanent_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34151 } }
I20260929 06:34:34.677947 20162 raft_consensus.cc:374] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:34.677989 20162 raft_consensus.cc:729] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4523585f14034619956b6f45e87c018d, State: Initialized, Role: FOLLOWER
I20260929 06:34:34.678118 20162 consensus_queue.cc:260] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523585f14034619956b6f45e87c018d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 46257 } } peers { permanent_uuid: "39fd47d32c7741b38812cbc55d89dc4d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 34299 } } peers { permanent_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34151 } }
I20260929 06:34:34.678396 20162 ts_tablet_manager.cc:1428] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:34:34.678536 20011 heartbeater.cc:503] Master 127.9.61.126:34769 was elected leader, sending a full tablet report...
I20260929 06:34:34.678542 20163 raft_consensus.cc:348] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523585f14034619956b6f45e87c018d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 46257 } } peers { permanent_uuid: "39fd47d32c7741b38812cbc55d89dc4d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 34299 } } peers { permanent_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34151 } }
I20260929 06:34:34.678714 20163 raft_consensus.cc:374] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:34.678746 20163 raft_consensus.cc:729] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2fb3b3ffa404516a1b1c41c0fb3ce93, State: Initialized, Role: FOLLOWER
I20260929 06:34:34.678851 20163 consensus_queue.cc:260] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523585f14034619956b6f45e87c018d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 46257 } } peers { permanent_uuid: "39fd47d32c7741b38812cbc55d89dc4d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 34299 } } peers { permanent_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34151 } }
I20260929 06:34:34.678978 20164 raft_consensus.cc:348] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523585f14034619956b6f45e87c018d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 46257 } } peers { permanent_uuid: "39fd47d32c7741b38812cbc55d89dc4d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 34299 } } peers { permanent_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34151 } }
I20260929 06:34:34.679112 20163 ts_tablet_manager.cc:1428] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:34:34.679133 20164 raft_consensus.cc:374] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:34:34.679173 20164 raft_consensus.cc:729] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39fd47d32c7741b38812cbc55d89dc4d, State: Initialized, Role: FOLLOWER
I20260929 06:34:34.679284 20164 consensus_queue.cc:260] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523585f14034619956b6f45e87c018d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 46257 } } peers { permanent_uuid: "39fd47d32c7741b38812cbc55d89dc4d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 34299 } } peers { permanent_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34151 } }
I20260929 06:34:34.679591 20145 heartbeater.cc:503] Master 127.9.61.126:34769 was elected leader, sending a full tablet report...
I20260929 06:34:34.679574 20164 ts_tablet_manager.cc:1428] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:34:34.679636 19877 heartbeater.cc:503] Master 127.9.61.126:34769 was elected leader, sending a full tablet report...
W20260929 06:34:34.729835 20012 tablet.cc:2369] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:34:34.825838 19878 tablet.cc:2369] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:34:34.884895 20146 tablet.cc:2369] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:34:34.943894 20168 raft_consensus.cc:482] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:34:34.944037 20168 raft_consensus.cc:504] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523585f14034619956b6f45e87c018d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 46257 } } peers { permanent_uuid: "39fd47d32c7741b38812cbc55d89dc4d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 34299 } } peers { permanent_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34151 } }
I20260929 06:34:34.944393 20168 leader_election.cc:288] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39fd47d32c7741b38812cbc55d89dc4d (127.9.61.67:34299), a2fb3b3ffa404516a1b1c41c0fb3ce93 (127.9.61.65:34151)
I20260929 06:34:34.947074 20159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.944632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:47601 (local address 127.9.61.65:34151)
0929 06:34:34.944694 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:34.944696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:34.944705 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:34:34.944736 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:34.944736 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:34.944748 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:34.944824 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:34.944977 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.945433 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.946367 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.946718 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.946801 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.946811 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:34.946962 (+ 151us) server_negotiation.cc:299] Negotiation successful
0929 06:34:34.947013 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:34:34.947074 20013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.944559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:34151 (local address 127.9.61.66:47601)
0929 06:34:34.944612 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:34.944625 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:34.944678 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:34.944827 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:34.944828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:34.944830 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:34.944905 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.944907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.945518 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.945519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.946272 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.946274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.946804 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.946805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.946884 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.946887 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:34:34.946957 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 06:34:34.946999 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 06:34:34.947242 20160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.944628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:36599 (local address 127.9.61.67:34299)
0929 06:34:34.944699 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:34.944701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:34.944847 (+ 146us) server_negotiation.cc:407] Connection header received
0929 06:34:34.944922 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:34.944923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:34.944934 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:34.945000 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:34:34.945149 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.945589 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.946496 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.946878 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.946962 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.946971 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:34.947129 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 06:34:34.947166 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 06:34:34.947474 20171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:34.944573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:34299 (local address 127.9.61.66:36599)
0929 06:34:34.944762 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:34.944773 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:34:34.944856 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:34:34.945002 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:34:34.945003 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:34:34.945005 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:34:34.945072 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.945073 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.945677 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.945678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.946404 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:34:34.946405 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:34:34.946963 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:34:34.946964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:34:34.947040 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:34.947044 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:34:34.947350 (+ 306us) client_negotiation.cc:240] Negotiation successful
0929 06:34:34.947394 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":120,"threads_started":1}
I20260929 06:34:34.947438 19831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31620032d39f41e79b178f5dc077c799" candidate_uuid: "4523585f14034619956b6f45e87c018d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93" is_pre_election: true
I20260929 06:34:34.947603 19831 raft_consensus.cc:2454] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4523585f14034619956b6f45e87c018d in term 0.
I20260929 06:34:34.947801 20099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31620032d39f41e79b178f5dc077c799" candidate_uuid: "4523585f14034619956b6f45e87c018d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39fd47d32c7741b38812cbc55d89dc4d" is_pre_election: true
I20260929 06:34:34.947901 19898 leader_election.cc:302] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4523585f14034619956b6f45e87c018d, a2fb3b3ffa404516a1b1c41c0fb3ce93; no voters:
I20260929 06:34:34.947924 20099 raft_consensus.cc:2454] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4523585f14034619956b6f45e87c018d in term 0.
I20260929 06:34:34.948057 20168 raft_consensus.cc:2781] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:34:34.948117 20168 raft_consensus.cc:482] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:34:34.948144 20168 raft_consensus.cc:3037] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:34.948845 20168 raft_consensus.cc:504] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523585f14034619956b6f45e87c018d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 46257 } } peers { permanent_uuid: "39fd47d32c7741b38812cbc55d89dc4d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 34299 } } peers { permanent_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34151 } }
I20260929 06:34:34.948992 20168 leader_election.cc:288] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [CANDIDATE]: Term 1 election: Requested vote from peers 39fd47d32c7741b38812cbc55d89dc4d (127.9.61.67:34299), a2fb3b3ffa404516a1b1c41c0fb3ce93 (127.9.61.65:34151)
I20260929 06:34:34.949167 19831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31620032d39f41e79b178f5dc077c799" candidate_uuid: "4523585f14034619956b6f45e87c018d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93"
I20260929 06:34:34.949195 20099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31620032d39f41e79b178f5dc077c799" candidate_uuid: "4523585f14034619956b6f45e87c018d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39fd47d32c7741b38812cbc55d89dc4d"
I20260929 06:34:34.949265 19831 raft_consensus.cc:3037] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:34.949261 20099 raft_consensus.cc:3037] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:34:34.949973 19831 raft_consensus.cc:2454] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4523585f14034619956b6f45e87c018d in term 1.
I20260929 06:34:34.949981 20099 raft_consensus.cc:2454] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4523585f14034619956b6f45e87c018d in term 1.
I20260929 06:34:34.950179 19900 leader_election.cc:302] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39fd47d32c7741b38812cbc55d89dc4d, 4523585f14034619956b6f45e87c018d; no voters:
I20260929 06:34:34.950284 20168 raft_consensus.cc:2781] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:34:34.950433 20168 raft_consensus.cc:686] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 1 LEADER]: Becoming Leader. State: Replica: 4523585f14034619956b6f45e87c018d, State: Running, Role: LEADER
I20260929 06:34:34.950527 20168 consensus_queue.cc:237] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523585f14034619956b6f45e87c018d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 46257 } } peers { permanent_uuid: "39fd47d32c7741b38812cbc55d89dc4d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 34299 } } peers { permanent_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34151 } }
I20260929 06:34:34.951277 19685 catalog_manager.cc:5495] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4523585f14034619956b6f45e87c018d (127.9.61.66). New cstate: current_term: 1 leader_uuid: "4523585f14034619956b6f45e87c018d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4523585f14034619956b6f45e87c018d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 46257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39fd47d32c7741b38812cbc55d89dc4d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 34299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34151 } health_report { overall_health: UNKNOWN } } }
I20260929 06:34:35.021766 20161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:35.019341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40550 (local address 127.9.61.66:46257)
0929 06:34:35.019443 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0929 06:34:35.019446 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:34:35.019454 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:34:35.019500 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:34:35.019501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:34:35.019520 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:34:35.019604 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:34:35.019758 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:35.020301 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:35.021080 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:34:35.021263 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:34:35.021314 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:34:35.021448 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:34:35.021541 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:34:35.021606 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:34:35.021626 (+ 20us) server_negotiation.cc:299] Negotiation successful
0929 06:34:35.021644 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260929 06:34:35.023599 20099 raft_consensus.cc:1261] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d [term 1 FOLLOWER]: Refusing update from remote peer 4523585f14034619956b6f45e87c018d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:35.023610 19831 raft_consensus.cc:1261] T 31620032d39f41e79b178f5dc077c799 P a2fb3b3ffa404516a1b1c41c0fb3ce93 [term 1 FOLLOWER]: Refusing update from remote peer 4523585f14034619956b6f45e87c018d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:34:35.024019 20172 consensus_queue.cc:1035] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [LEADER]: Connected to new peer: Peer: permanent_uuid: "39fd47d32c7741b38812cbc55d89dc4d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 34299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:35.024223 20168 consensus_queue.cc:1035] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2fb3b3ffa404516a1b1c41c0fb3ce93" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:34:35.026571 20175 mvcc.cc:205] Tried to move back new op lower bound from 7334558412893732864 to 7334558412597800960. Current Snapshot: MvccSnapshot[applied={T|T < 7334558412893732864}]
I20260929 06:34:35.026731 20176 mvcc.cc:205] Tried to move back new op lower bound from 7334558412893732864 to 7334558412597800960. Current Snapshot: MvccSnapshot[applied={T|T < 7334558412893732864}]
I20260929 06:34:35.028927 19686 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:35.029016 19686 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:34:35.029773 19686 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ce5fb873c25d48f69b4237f43f07928a: Sending DeleteTablet for 3 replicas of tablet 31620032d39f41e79b178f5dc077c799
I20260929 06:34:35.030093 20079 tablet_service.cc:1514] Processing DeleteTablet for tablet 31620032d39f41e79b178f5dc077c799 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:35 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:47190
I20260929 06:34:35.030143 19945 tablet_service.cc:1514] Processing DeleteTablet for tablet 31620032d39f41e79b178f5dc077c799 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:35 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:40538
I20260929 06:34:35.030349 19811 tablet_service.cc:1514] Processing DeleteTablet for tablet 31620032d39f41e79b178f5dc077c799 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:34:35 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:40434
I20260929 06:34:35.030480 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 19748
I20260929 06:34:35.031121 20186 tablet_replica.cc:330] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d: stopping tablet replica
I20260929 06:34:35.031283 20186 raft_consensus.cc:2229] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:34:35.031461 20186 raft_consensus.cc:2258] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:35.031659 20185 tablet_replica.cc:330] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d: stopping tablet replica
I20260929 06:34:35.031800 20185 raft_consensus.cc:2229] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:34:35.031993 20185 raft_consensus.cc:2258] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:34:35.032354 20186 ts_tablet_manager.cc:1905] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:35.032547 20185 ts_tablet_manager.cc:1905] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:34:35.034211 20185 ts_tablet_manager.cc:1918] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:35.034240 20186 ts_tablet_manager.cc:1918] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:34:35.034300 20186 log.cc:1196] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/31620032d39f41e79b178f5dc077c799
I20260929 06:34:35.034384 20185 log.cc:1196] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/31620032d39f41e79b178f5dc077c799
I20260929 06:34:35.034616 20186 ts_tablet_manager.cc:1939] T 31620032d39f41e79b178f5dc077c799 P 39fd47d32c7741b38812cbc55d89dc4d: Deleting consensus metadata
I20260929 06:34:35.034708 20185 ts_tablet_manager.cc:1939] T 31620032d39f41e79b178f5dc077c799 P 4523585f14034619956b6f45e87c018d: Deleting consensus metadata
I20260929 06:34:35.035063 19672 catalog_manager.cc:4841] TS 39fd47d32c7741b38812cbc55d89dc4d (127.9.61.67:34299): tablet 31620032d39f41e79b178f5dc077c799 (table test-table [id=ea26bcf7bce945d2b9e8e1bec2b6e1a3]) successfully deleted
I20260929 06:34:35.035230 19671 catalog_manager.cc:4841] TS 4523585f14034619956b6f45e87c018d (127.9.61.66:46257): tablet 31620032d39f41e79b178f5dc077c799 (table test-table [id=ea26bcf7bce945d2b9e8e1bec2b6e1a3]) successfully deleted
W20260929 06:34:35.037197 19670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:34151 (error 108)
I20260929 06:34:35.037501 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 19882
I20260929 06:34:35.038122 20157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:34:35.037586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:34151 (local address 127.0.0.1:40444)
0929 06:34:35.038032 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0929 06:34:35.038084 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:34151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426}
W20260929 06:34:35.038259 19670 catalog_manager.cc:4584] TS a2fb3b3ffa404516a1b1c41c0fb3ce93 (127.9.61.65:34151): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 31620032d39f41e79b178f5dc077c799: Network error: Client connection negotiation failed: client connection to 127.9.61.65:34151: connect: Connection refused (error 111)
I20260929 06:34:35.042737 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 20016
I20260929 06:34:35.047145 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 19654
2026-09-29T06:34:35Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2212 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:34:35 dist-test-slave-601b krb5kdc[20191](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:34:35 dist-test-slave-601b krb5kdc[20191](info): set up 2 sockets
Sep 29 06:34:35 dist-test-slave-601b krb5kdc[20191](info): commencing operation
krb5kdc: starting...
W20260929 06:34:36.073019 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.006s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:34:36 dist-test-slave-601b krb5kdc[20191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:34:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:34:36Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.9.61.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.9.61.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/rangeradmin_127.9.61.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/rangeradmin_127.9.61.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.9.61.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.9.61.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/rangerlookup_127.9.61.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/rangerlookup_127.9.61.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.61.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.9.61.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/HTTP_127.9.61.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/HTTP_127.9.61.84@KRBTEST.COM.keytab.
I20260929 06:34:36.239701 9461 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskA6qGeu/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/postgres -l logfile start
2026-09-29 06:34:38.734 UTC [20221] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-29 06:34:38.734 UTC [20221] LOG: listening on IPv4 address "127.9.61.84", port 46097
2026-09-29 06:34:38.738 UTC [20221] LOG: listening on Unix socket "/tmp/.s.PGSQL.46097"
2026-09-29 06:34:38.759 UTC [20224] LOG: database system was shut down at 2026-09-29 06:34:37 UTC
2026-09-29 06:34:38.763 UTC [20221] LOG: database system is ready to accept connections
I20260929 06:34:39.716784 9461 mini_postgres.cc:96] Postgres bound to 46097
2026-09-29 06:34:39.722 UTC [20232] FATAL: database "slave" does not exist
127.9.61.84:46097 - accepting connections
I20260929 06:34:39.723191 9461 mini_ranger.cc:161] Starting Ranger...
I20260929 06:34:39.737480 9461 mini_ranger.cc:84] Created miniranger Postgres user
I20260929 06:34:40.197134 9461 mini_ranger.cc:87] Created ranger Postgres database
I20260929 06:34:40.197232 9461 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-admin
2026-09-29 06:34:40,487 [I] DB FLAVOR :POSTGRES
2026-09-29 06:34:40,488 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 06:34:40,488 [I] Checking connection..
2026-09-29 06:34:40,488 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-29 06:34:40,748 [I] Checking connection passed.
2026-09-29 06:34:40,748 [I] --------- Verifying version history table ---------
2026-09-29 06:34:40,748 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 06:34:41,000 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 06:34:41,000 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 06:34:41,248 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 06:34:41,248 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-29 06:34:41,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-29 06:34:41.504 UTC [20296] WARNING: there is no transaction in progress
2026-09-29 06:34:41,509 [I] create_dbversion_catalog.sql file imported successfully
2026-09-29 06:34:41,510 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 06:34:41,754 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-29 06:34:41,754 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 06:34:41,754 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-29 06:34:41,995 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-29 06:34:42,222 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-601b.c.gcp-upstream.internal','N') ;"
2026-09-29 06:34:42,462 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 06:34:42,719 [I] Table x_portal_user does not exist in database ranger
2026-09-29 06:34:42,719 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 06:34:42,964 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-29 06:34:42,964 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 06:34:43,188 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 06:34:43,444 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-29 06:34:43,445 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-29 06:34:44.380 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.396 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.412 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.426 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.444 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.461 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.516 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.522 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.536 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.545 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.555 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.569 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.578 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.585 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.592 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:44.599 UTC [20404] WARNING: there is no transaction in progress
2026-09-29 06:34:45,240 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-29 06:34:45,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-29 06:34:45,469 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-29 06:34:45,470 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 06:34:45,728 [I] Table x_portal_user already exists in database 'ranger'
2026-09-29 06:34:45,728 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 06:34:45,986 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-29 06:34:45,986 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 06:34:46,225 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 06:34:46,477 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-601b.c.gcp-upstream.internal';"
2026-09-29 06:34:46,723 [I] CORE_DB_SCHEMA import status has been updated
2026-09-29 06:34:46,724 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-29 06:34:46,969 [I] DB_PATCHES have already been applied
I20260929 06:34:46.975692 9461 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-admin:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskA6qGeu/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260929 06:34:46.975786 9461 mini_ranger.cc:193] Using host: 127.9.61.84
I20260929 06:34:46.979096 9461 mini_ranger.cc:227] Ranger admin URL: http://127.9.61.84:51727
Sep 29, 2026 6:34:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 6:34:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 6:34:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-admin/ews/webapp
Sep 29, 2026 6:34:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 29, 2026 6:34:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 29, 2026 6:34:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-admin/ews/webapp].
Sep 29, 2026 6:34:47 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260929 06:34:48.159124 9461 mini_ranger.cc:160] Time spent starting Ranger: real 8.436s user 0.000s sys 0.009s
Sep 29, 2026 6:35:07 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 29, 2026 6:35:07 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Sep 29, 2026 6:35:07 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 29, 2026 6:35:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 29, 2026 6:35:07 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 29, 2026 6:35:08 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260929 06:35:08.821882 9461 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.9.61.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.9.61.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/rangerkms_127.9.61.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/rangerkms_127.9.61.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.61.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.9.61.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.61.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/HTTP_127.9.61.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.61.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/HTTP_127.9.61.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 29 06:35:08 dist-test-slave-601b krb5kdc[20191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663708, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260929 06:35:08.924340 9461 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260929 06:35:08.933729 9461 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260929 06:35:09.804872 9461 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260929 06:35:09.804965 9461 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-kms
I20260929 06:35:09.804987 9461 mini_ranger_kms.cc:227] Using postgres at 127.9.61.84:46097
2026-09-29 06:35:09,992 [I] DB FLAVOR :POSTGRES
2026-09-29 06:35:09,992 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 06:35:09,992 [I] Checking connection
2026-09-29 06:35:09,992 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-29 06:35:10,256 [I] connection success
2026-09-29 06:35:10,256 [I] --------- Verifying Ranger DB tables ---------
2026-09-29 06:35:10,256 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-29 06:35:10,256 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-29 06:35:10,484 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-29 06:35:10,484 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 06:35:10,484 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-29 06:35:10,484 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:46097/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-29 06:35:10,736 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260929 06:35:11.234499 9461 mini_ranger_kms.cc:310] Created kms service
I20260929 06:35:11.413913 9461 mini_ranger_kms.cc:326] Created kudu user
I20260929 06:35:11.458204 9461 mini_ranger_kms.cc:343] Created rangerkms user
Sep 29 06:35:11 dist-test-slave-601b krb5kdc[20191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663708, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:35:11.876504 9461 mini_ranger_kms.cc:384] Added ranger policy
I20260929 06:35:11.876621 9461 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-kms:/tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260929 06:35:11.876642 9461 mini_ranger_kms.cc:240] Using host: 127.9.61.84
I20260929 06:35:11.880743 9461 mini_ranger_kms.cc:276] Ranger KMS PID: 20584
I20260929 06:35:11.880868 9461 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.9.61.84:54899
Sep 29, 2026 6:35:12 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 6:35:12 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 6:35:12 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 29, 2026 6:35:12 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 29, 2026 6:35:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-kms/ews/webapp].
Sep 29, 2026 6:35:13 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260929 06:35:14.159230 9461 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.235s user 0.003s sys 0.163s
I20260929 06:35:14.159354 9461 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260929 06:35:14.159436 9461 mini_ranger_kms.cc:401] 127.9.61.84:54899/kms/v1/keys
Sep 29 06:35:14 dist-test-slave-601b krb5kdc[20191](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790663714, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.61.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 29 06:35:14 dist-test-slave-601b krb5kdc[20191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663714, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.61.84@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
Sep 29 06:35:14 dist-test-slave-601b krb5kdc[20191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663714, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.61.84@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
Sep 29 06:35:17 dist-test-slave-601b krb5kdc[20191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:35:17.125279 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:32859
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:32859
--ranger_config_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.61.84:54899/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:35:17.207271 20635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:35:17.207468 20635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:35:17.207489 20635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:35:17.208724 20635 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:35:17.208777 20635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:35:17.208792 20635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:35:17.208804 20635 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:35:17.208817 20635 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:35:17.210361 20635 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/wal
--ranger_kms_url=127.9.61.84:54899/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:32859
--ranger_config_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:32859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:35:17.210530 20635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:35:17.210692 20635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:35:17.216164 20643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:35:17.216187 20641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:35:17.216167 20635 server_base.cc:1034] running on GCE node
W20260929 06:35:17.216172 20640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:35:17.216568 20635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:35:17.216874 20635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:35:17.218042 20635 hybrid_clock.cc:648] HybridClock initialized: now 1790663717218035 us; error 39 us; skew 500 ppm
Sep 29 06:35:17 dist-test-slave-601b krb5kdc[20191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663717, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:35:17.223305 20635 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:35:17.223742 20635 webserver.cc:460] Webserver started at http://127.9.61.126:40871/ using document root <none> and password file <none>
I20260929 06:35:17.224032 20635 fs_manager.cc:359] Metadata directory not provided
I20260929 06:35:17.224097 20635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:35:17.224272 20635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:35:17 dist-test-slave-601b krb5kdc[20191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663717, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:35:17.270658 20635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "7029cd12507844809b76796326d88d51"
format_stamp: "Formatted at 2026-09-29 06:35:17 on dist-test-slave-601b"
server_key: "2c4d2ad23c29bffadeb39f405ed5f4fc"
server_key_iv: "995cf740632c78efe34ca9999fd9557d"
server_key_version: "kuduclusterkey@0"
I20260929 06:35:17.271098 20635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "7029cd12507844809b76796326d88d51"
format_stamp: "Formatted at 2026-09-29 06:35:17 on dist-test-slave-601b"
server_key: "2c4d2ad23c29bffadeb39f405ed5f4fc"
server_key_iv: "995cf740632c78efe34ca9999fd9557d"
server_key_version: "kuduclusterkey@0"
I20260929 06:35:17.272827 20635 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260929 06:35:17.288887 20650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:35:17.289131 20635 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:35:17.289258 20635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "7029cd12507844809b76796326d88d51"
format_stamp: "Formatted at 2026-09-29 06:35:17 on dist-test-slave-601b"
server_key: "2c4d2ad23c29bffadeb39f405ed5f4fc"
server_key_iv: "995cf740632c78efe34ca9999fd9557d"
server_key_version: "kuduclusterkey@0"
I20260929 06:35:17.289381 20635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:35:17.297004 20635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:35:17.299145 20635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:35:17.299290 20635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:35:17.304718 20635 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:32859
I20260929 06:35:17.304762 20702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:32859 every 8 connection(s)
I20260929 06:35:17.305115 20635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:35:17.305775 20703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:35:17.308059 20703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51: Bootstrap starting.
I20260929 06:35:17.308665 20703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51: Neither blocks nor log segments found. Creating new log.
I20260929 06:35:17.308962 20703 log.cc:824] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51: Log is configured to *not* fsync() on all Append() calls
I20260929 06:35:17.309661 20703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51: No bootstrap required, opened a new log
I20260929 06:35:17.311188 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 20635
I20260929 06:35:17.311298 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:35:17.311489 9461 external_mini_cluster.cc:1428] Setting key 066700f8160395d0f499b56a74ffded6
I20260929 06:35:17.311895 20703 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7029cd12507844809b76796326d88d51" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32859 } }
I20260929 06:35:17.312220 20703 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:35:17.312280 20703 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7029cd12507844809b76796326d88d51, State: Initialized, Role: FOLLOWER
I20260929 06:35:17.312434 20703 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7029cd12507844809b76796326d88d51" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32859 } }
I20260929 06:35:17.312620 20703 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:35:17.312714 20703 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:35:17.312780 20703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:35:17.313539 20703 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7029cd12507844809b76796326d88d51" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32859 } }
I20260929 06:35:17.313658 20703 leader_election.cc:302] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7029cd12507844809b76796326d88d51; no voters:
I20260929 06:35:17.313859 20708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:35:17.313889 20703 leader_election.cc:288] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:35:17.314853 20708 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [term 1 LEADER]: Becoming Leader. State: Replica: 7029cd12507844809b76796326d88d51, State: Running, Role: LEADER
I20260929 06:35:17.315058 20703 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:35:17.315826 20708 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7029cd12507844809b76796326d88d51" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32859 } }
I20260929 06:35:17.317291 20703 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Sep 29 06:35:17 dist-test-slave-601b krb5kdc[20191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:35:17.320663 20709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7029cd12507844809b76796326d88d51. Latest consensus state: current_term: 1 leader_uuid: "7029cd12507844809b76796326d88d51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7029cd12507844809b76796326d88d51" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32859 } } }
I20260929 06:35:17.320849 20709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [sys.catalog]: This master's current role is: LEADER
I20260929 06:35:17.320979 20710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7029cd12507844809b76796326d88d51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7029cd12507844809b76796326d88d51" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32859 } } }
I20260929 06:35:17.321414 20710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51 [sys.catalog]: This master's current role is: LEADER
I20260929 06:35:17.321635 20725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:35:17.322381 20725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:35:17.324856 20725 catalog_manager.cc:1347] Generated new cluster ID: 08fbe8b39962499fb1c3ec57267aa6fe
I20260929 06:35:17.324955 20725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:35:17.325196 20707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:17.312053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41626 (local address 127.9.61.126:32859)
0929 06:35:17.312243 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0929 06:35:17.312252 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:35:17.312284 (+ 32us) server_negotiation.cc:407] Connection header received
0929 06:35:17.312407 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:35:17.312414 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:35:17.312471 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:35:17.312618 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:35:17.313424 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:17.314860 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:17.315748 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:17.316395 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:17.316518 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:17.319879 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:35:17.319928 (+ 49us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:35:17.319929 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:35:17.320043 (+ 114us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:35:17.322892 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:35:17.323329 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:35:17.323333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:35:17.323333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:35:17.323487 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:35:17.323737 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:35:17.323738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:35:17.323738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:35:17.324145 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:35:17.324293 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0929 06:35:17.324821 (+ 528us) server_negotiation.cc:299] Negotiation successful
0929 06:35:17.324968 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":80,"threads_started":1}
I20260929 06:35:17.346776 20725 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:35:17.347635 20725 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:35:17.351197 20725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51: Generated new TSK 0
I20260929 06:35:17.351455 20725 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:35:18.083017 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.61.84:54899/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32859
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:35:18.201437 20748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:35:18.201764 20748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:35:18.201809 20748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:35:18.203145 20748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:35:18.203217 20748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:35:18.203263 20748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:35:18.204838 20748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.9.61.84:54899/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:35:18.205104 20748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:35:18.205338 20748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:35:18.211755 20754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:35:18.211762 20753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:35:18.212386 20756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:35:18.213083 20748 server_base.cc:1034] running on GCE node
I20260929 06:35:18.213341 20748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:35:18.213627 20748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:35:18.214810 20748 hybrid_clock.cc:648] HybridClock initialized: now 1790663718214786 us; error 37 us; skew 500 ppm
Sep 29 06:35:18 dist-test-slave-601b krb5kdc[20191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663718, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:35:18.218010 20748 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:35:18.218451 20748 webserver.cc:460] Webserver started at http://127.9.61.65:42811/ using document root <none> and password file <none>
I20260929 06:35:18.218719 20748 fs_manager.cc:359] Metadata directory not provided
I20260929 06:35:18.218787 20748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:35:18.218940 20748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:35:18 dist-test-slave-601b krb5kdc[20191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663718, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:35:18.232765 20748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "04094507e56d47168cf360f28c62b084"
format_stamp: "Formatted at 2026-09-29 06:35:18 on dist-test-slave-601b"
server_key: "8cc0a8684c9c28e33ff7a7d70f6d4bcc"
server_key_iv: "60f7f64f7dc776852f4558cfc5946eaa"
server_key_version: "kuduclusterkey@0"
I20260929 06:35:18.233183 20748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "04094507e56d47168cf360f28c62b084"
format_stamp: "Formatted at 2026-09-29 06:35:18 on dist-test-slave-601b"
server_key: "8cc0a8684c9c28e33ff7a7d70f6d4bcc"
server_key_iv: "60f7f64f7dc776852f4558cfc5946eaa"
server_key_version: "kuduclusterkey@0"
I20260929 06:35:18.235262 20748 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260929 06:35:18.257789 20764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:35:18.258100 20748 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260929 06:35:18.258288 20748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "04094507e56d47168cf360f28c62b084"
format_stamp: "Formatted at 2026-09-29 06:35:18 on dist-test-slave-601b"
server_key: "8cc0a8684c9c28e33ff7a7d70f6d4bcc"
server_key_iv: "60f7f64f7dc776852f4558cfc5946eaa"
server_key_version: "kuduclusterkey@0"
I20260929 06:35:18.258504 20748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:35:18.273727 20748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:35:18.276593 20748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:35:18.276842 20748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:35:18.277153 20748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:35:18.277633 20748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:35:18.277736 20748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:35:18.277869 20748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:35:18.277962 20748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:35:18.287225 20748 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:43953
I20260929 06:35:18.287357 20878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:43953 every 8 connection(s)
I20260929 06:35:18.287964 20748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:35:18.290154 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 20748
I20260929 06:35:18.290282 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:35:18.290527 9461 external_mini_cluster.cc:1428] Setting key a6ea824266b602c915dd8dfd254761e6
Sep 29 06:35:18 dist-test-slave-601b krb5kdc[20191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663718, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
I20260929 06:35:18.307173 20881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.288957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32859 (local address 127.9.61.65:45377)
0929 06:35:18.289251 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0929 06:35:18.289302 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0929 06:35:18.289982 (+ 680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:35:18.290399 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:35:18.290404 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:35:18.290645 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:35:18.291137 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:18.291144 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.292223 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.292225 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:18.293648 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:18.293651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.294196 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.294197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:18.294359 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.295074 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:35:18.295084 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:35:18.298061 (+ 2977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:35:18.300341 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:35:18.300363 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:35:18.300369 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:35:18.300705 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:35:18.300939 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:35:18.300940 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:35:18.300940 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:35:18.301101 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:35:18.301408 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:35:18.301415 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:35:18.306420 (+ 5005us) client_negotiation.cc:769] Sending connection context
0929 06:35:18.306636 (+ 216us) client_negotiation.cc:240] Negotiation successful
0929 06:35:18.306886 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":86,"threads_started":1}
I20260929 06:35:18.307883 20882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.288998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:45377 (local address 127.9.61.126:32859)
0929 06:35:18.289180 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0929 06:35:18.289182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:35:18.289444 (+ 262us) server_negotiation.cc:407] Connection header received
0929 06:35:18.290157 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:35:18.290159 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:35:18.290174 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:35:18.290249 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:35:18.291240 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.292082 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.293755 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.294058 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.294124 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.298199 (+ 4075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:35:18.298201 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:35:18.298201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:35:18.298211 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:35:18.300231 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:35:18.300796 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:35:18.300798 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:35:18.300798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:35:18.300868 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:35:18.301171 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:35:18.301172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:35:18.301173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:35:18.301315 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:35:18.301382 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 06:35:18.307637 (+ 6255us) server_negotiation.cc:299] Negotiation successful
0929 06:35:18.307767 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":96,"threads_started":1}
I20260929 06:35:18.308842 20879 heartbeater.cc:347] Connected to a master server at 127.9.61.126:32859
I20260929 06:35:18.309373 20879 heartbeater.cc:464] Registering TS with master...
I20260929 06:35:18.309612 20879 heartbeater.cc:511] Master 127.9.61.126:32859 requested a full tablet report, sending...
I20260929 06:35:18.310374 20667 ts_manager.cc:194] Registered new tserver with Master: 04094507e56d47168cf360f28c62b084 (127.9.61.65:43953)
I20260929 06:35:18.311401 20667 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:45377
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:35:18.330269 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.61.84:54899/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32859
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:35:18.452157 20885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:35:18.452515 20885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:35:18.452598 20885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:35:18.454396 20885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:35:18.454635 20885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:35:18.454766 20885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:35:18.457082 20885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.9.61.84:54899/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:35:18.457563 20885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:35:18.458005 20885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:35:18.465174 20893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:35:18.465195 20895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:35:18.465350 20892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:35:18.466549 20885 server_base.cc:1034] running on GCE node
I20260929 06:35:18.466898 20885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:35:18.467182 20885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:35:18.468346 20885 hybrid_clock.cc:648] HybridClock initialized: now 1790663718468327 us; error 37 us; skew 500 ppm
Sep 29 06:35:18 dist-test-slave-601b krb5kdc[20191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663718, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:35:18.471784 20885 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:35:18.472321 20885 webserver.cc:460] Webserver started at http://127.9.61.66:42897/ using document root <none> and password file <none>
I20260929 06:35:18.472568 20885 fs_manager.cc:359] Metadata directory not provided
I20260929 06:35:18.472615 20885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:35:18.472750 20885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:35:18 dist-test-slave-601b krb5kdc[20191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663718, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:35:18.493352 20885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "585200303bcb4424b47272bbc42b33ae"
format_stamp: "Formatted at 2026-09-29 06:35:18 on dist-test-slave-601b"
server_key: "017b963af0ad8dbe9a6950bc2a39e563"
server_key_iv: "242f0f5afed6bcb0ff6333ffd5f12bb9"
server_key_version: "kuduclusterkey@0"
I20260929 06:35:18.493882 20885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "585200303bcb4424b47272bbc42b33ae"
format_stamp: "Formatted at 2026-09-29 06:35:18 on dist-test-slave-601b"
server_key: "017b963af0ad8dbe9a6950bc2a39e563"
server_key_iv: "242f0f5afed6bcb0ff6333ffd5f12bb9"
server_key_version: "kuduclusterkey@0"
Sep 29 06:35:18 dist-test-slave-601b krb5kdc[20191](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790663718, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:35:18.496707 20885 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260929 06:35:18.512123 20902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:35:18.512430 20885 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260929 06:35:18.512533 20885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "585200303bcb4424b47272bbc42b33ae"
format_stamp: "Formatted at 2026-09-29 06:35:18 on dist-test-slave-601b"
server_key: "017b963af0ad8dbe9a6950bc2a39e563"
server_key_iv: "242f0f5afed6bcb0ff6333ffd5f12bb9"
server_key_version: "kuduclusterkey@0"
I20260929 06:35:18.512639 20885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:35:18.536544 20885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:35:18.539389 20885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:35:18.539621 20885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:35:18.539903 20885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:35:18.540373 20885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:35:18.540472 20885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:35:18.540548 20885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:35:18.540611 20885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:35:18.548385 20885 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:40577
I20260929 06:35:18.548938 20885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:35:18.549916 21015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:40577 every 8 connection(s)
I20260929 06:35:18.556704 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 20885
I20260929 06:35:18.556826 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:35:18.557037 9461 external_mini_cluster.cc:1428] Setting key 2b51bc10da87a794b0437a960013cf49
Sep 29 06:35:18 dist-test-slave-601b krb5kdc[20191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663718, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:35:18.564857 20882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.550928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:33521 (local address 127.9.61.126:32859)
0929 06:35:18.550982 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 06:35:18.550984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:35:18.551338 (+ 354us) server_negotiation.cc:407] Connection header received
0929 06:35:18.552156 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:35:18.552157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:35:18.552174 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:35:18.552214 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:35:18.553182 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.554263 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.556964 (+ 2701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.557490 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.557561 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.560969 (+ 3408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:35:18.560970 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:35:18.560971 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:35:18.560980 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:35:18.562860 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:35:18.563477 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:35:18.563478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:35:18.563479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:35:18.563543 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:35:18.563913 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:35:18.563914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:35:18.563915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:35:18.564103 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:35:18.564170 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 06:35:18.564633 (+ 463us) server_negotiation.cc:299] Negotiation successful
0929 06:35:18.564744 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:35:18.565765 21018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.550628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32859 (local address 127.9.61.66:33521)
0929 06:35:18.551192 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0929 06:35:18.551237 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 06:35:18.552004 (+ 767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:35:18.552466 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:35:18.552470 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:35:18.552744 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:35:18.553056 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:18.553063 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.554446 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.554447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:18.556769 (+ 2322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:18.556774 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.557701 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.557702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:18.558038 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.558870 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:35:18.558882 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:35:18.560829 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:35:18.562980 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:35:18.562989 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:35:18.562993 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:35:18.563379 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:35:18.563622 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:35:18.563623 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:35:18.563624 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:35:18.563823 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:35:18.564209 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:35:18.564216 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:35:18.564446 (+ 230us) client_negotiation.cc:769] Sending connection context
0929 06:35:18.565291 (+ 845us) client_negotiation.cc:240] Negotiation successful
0929 06:35:18.565491 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":92,"threads_started":1}
I20260929 06:35:18.566520 21016 heartbeater.cc:347] Connected to a master server at 127.9.61.126:32859
I20260929 06:35:18.566624 21016 heartbeater.cc:464] Registering TS with master...
I20260929 06:35:18.566836 21016 heartbeater.cc:511] Master 127.9.61.126:32859 requested a full tablet report, sending...
I20260929 06:35:18.567293 20667 ts_manager.cc:194] Registered new tserver with Master: 585200303bcb4424b47272bbc42b33ae (127.9.61.66:40577)
I20260929 06:35:18.567828 20667 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:33521
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:35:18.600692 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.61.84:54899/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32859
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:35:18.734181 21021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:35:18.734514 21021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:35:18.734555 21021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:35:18.736493 21021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:35:18.736558 21021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:35:18.736603 21021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:35:18.738998 21021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.9.61.84:54899/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:35:18.739454 21021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:35:18.739801 21021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:35:18.746338 21028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:35:18.746353 21030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:35:18.746624 21027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:35:18.747233 21021 server_base.cc:1034] running on GCE node
I20260929 06:35:18.747464 21021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:35:18.747741 21021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:35:18.748911 21021 hybrid_clock.cc:648] HybridClock initialized: now 1790663718748876 us; error 50 us; skew 500 ppm
Sep 29 06:35:18 dist-test-slave-601b krb5kdc[20191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663718, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:35:18.753063 21021 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:35:18.753690 21021 webserver.cc:460] Webserver started at http://127.9.61.67:36683/ using document root <none> and password file <none>
I20260929 06:35:18.754030 21021 fs_manager.cc:359] Metadata directory not provided
I20260929 06:35:18.754154 21021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:35:18.754359 21021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:35:18 dist-test-slave-601b krb5kdc[20191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663718, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:35:18.766469 21021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "2ffedf75f2bb4359b7abe0eb17c901de"
format_stamp: "Formatted at 2026-09-29 06:35:18 on dist-test-slave-601b"
server_key: "ee840821a7fdee974518d38c86f41c0e"
server_key_iv: "3d125ef93eea3f411d246423c8b6dc9b"
server_key_version: "kuduclusterkey@0"
I20260929 06:35:18.766891 21021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "2ffedf75f2bb4359b7abe0eb17c901de"
format_stamp: "Formatted at 2026-09-29 06:35:18 on dist-test-slave-601b"
server_key: "ee840821a7fdee974518d38c86f41c0e"
server_key_iv: "3d125ef93eea3f411d246423c8b6dc9b"
server_key_version: "kuduclusterkey@0"
I20260929 06:35:18.773278 21021 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.000s
I20260929 06:35:18.795708 21037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:35:18.796038 21021 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.001s sys 0.000s
I20260929 06:35:18.796146 21021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "2ffedf75f2bb4359b7abe0eb17c901de"
format_stamp: "Formatted at 2026-09-29 06:35:18 on dist-test-slave-601b"
server_key: "ee840821a7fdee974518d38c86f41c0e"
server_key_iv: "3d125ef93eea3f411d246423c8b6dc9b"
server_key_version: "kuduclusterkey@0"
I20260929 06:35:18.796249 21021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:35:18.809800 21021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:35:18.812161 21021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:35:18.812350 21021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:35:18.812737 21021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:35:18.813141 21021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:35:18.813210 21021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:35:18.813318 21021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:35:18.813377 21021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:35:18.819370 21021 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:44363
I20260929 06:35:18.819828 21021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:35:18.827392 21150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:44363 every 8 connection(s)
I20260929 06:35:18.829975 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 21021
I20260929 06:35:18.830082 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:35:18.830286 9461 external_mini_cluster.cc:1428] Setting key c4ae220b8dd7c4bd6f32f9a6acde3624
Sep 29 06:35:18 dist-test-slave-601b krb5kdc[20191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663718, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:35:18.850462 20882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.828019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:53719 (local address 127.9.61.126:32859)
0929 06:35:18.828070 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:35:18.828073 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:35:18.828428 (+ 355us) server_negotiation.cc:407] Connection header received
0929 06:35:18.829021 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:35:18.829022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:35:18.829037 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:35:18.829113 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:35:18.829728 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.830595 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.832293 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.832514 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.832613 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.846593 (+ 13980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:35:18.846595 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:35:18.846595 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:35:18.846604 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:35:18.848606 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:35:18.849192 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:35:18.849193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:35:18.849194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:35:18.849256 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:35:18.849579 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:35:18.849580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:35:18.849580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:35:18.849736 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:35:18.849813 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:35:18.850257 (+ 444us) server_negotiation.cc:299] Negotiation successful
0929 06:35:18.850353 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:35:18.851114 21153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.828042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32859 (local address 127.9.61.67:53719)
0929 06:35:18.828300 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0929 06:35:18.828333 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 06:35:18.828896 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:35:18.829196 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:35:18.829201 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:35:18.829407 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:35:18.829618 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:18.829623 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.830882 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.830883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:18.832177 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:18.832180 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.832638 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.832639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:18.832772 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.844502 (+ 11730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:35:18.844517 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:35:18.846451 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:35:18.848723 (+ 2272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:35:18.848734 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:35:18.848737 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:35:18.849093 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:35:18.849335 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:35:18.849336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:35:18.849337 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:35:18.849493 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:35:18.849854 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:35:18.849861 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:35:18.850077 (+ 216us) client_negotiation.cc:769] Sending connection context
0929 06:35:18.850629 (+ 552us) client_negotiation.cc:240] Negotiation successful
0929 06:35:18.850837 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":85,"threads_started":1}
I20260929 06:35:18.851802 21151 heartbeater.cc:347] Connected to a master server at 127.9.61.126:32859
I20260929 06:35:18.851920 21151 heartbeater.cc:464] Registering TS with master...
I20260929 06:35:18.852197 21151 heartbeater.cc:511] Master 127.9.61.126:32859 requested a full tablet report, sending...
I20260929 06:35:18.852656 20666 ts_manager.cc:194] Registered new tserver with Master: 2ffedf75f2bb4359b7abe0eb17c901de (127.9.61.67:44363)
I20260929 06:35:18.853173 20666 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:53719
I20260929 06:35:18.853721 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:35:18.861976 20882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.855351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41642 (local address 127.9.61.126:32859)
0929 06:35:18.855392 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:35:18.855394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:35:18.855566 (+ 172us) server_negotiation.cc:407] Connection header received
0929 06:35:18.855617 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:35:18.855618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:35:18.855628 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:35:18.855696 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:35:18.856419 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.856935 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.857691 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.857900 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.857975 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.859180 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:35:18.859181 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:35:18.859182 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:35:18.859188 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:35:18.860699 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:35:18.861126 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:35:18.861127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:35:18.861128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:35:18.861183 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:35:18.861411 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:35:18.861412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:35:18.861412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:35:18.861532 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:35:18.861605 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:35:18.861815 (+ 210us) server_negotiation.cc:299] Negotiation successful
0929 06:35:18.861887 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:35:18.864374 20666 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41642:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:35:18.866194 20666 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:35:18.879112 21163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.872054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:44363 (local address 127.0.0.1:41594)
0929 06:35:18.873770 (+ 1716us) negotiation.cc:107] Waiting for socket to connect
0929 06:35:18.873793 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0929 06:35:18.873834 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:35:18.874247 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:35:18.874247 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:35:18.874249 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:35:18.874299 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:18.874301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.875981 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.875982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:18.877688 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:18.877690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.878817 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.878818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:18.878902 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.878915 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 06:35:18.878960 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 06:35:18.879008 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1700,"mutex_wait_us":2,"thread_start_us":88,"threads_started":1}
I20260929 06:35:18.880759 21166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.872370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41594 (local address 127.9.61.67:44363)
0929 06:35:18.874086 (+ 1716us) server_negotiation.cc:206] Beginning negotiation
0929 06:35:18.874091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:35:18.874100 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:35:18.874138 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:35:18.874140 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:35:18.874155 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:35:18.874368 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:35:18.874435 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.875864 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.877802 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.878713 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.879566 (+ 853us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.880615 (+ 1049us) server_negotiation.cc:1035] Waiting for connection context
0929 06:35:18.880641 (+ 26us) server_negotiation.cc:299] Negotiation successful
0929 06:35:18.880681 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1680,"thread_start_us":63,"threads_started":1}
I20260929 06:35:18.879313 21167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.872054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:40577 (local address 127.0.0.1:35254)
0929 06:35:18.873335 (+ 1281us) negotiation.cc:107] Waiting for socket to connect
0929 06:35:18.873366 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0929 06:35:18.873421 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:35:18.873687 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:35:18.873689 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:35:18.873692 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:35:18.873765 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:18.873767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.876579 (+ 2812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.876579 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:18.877850 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:18.877852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.879089 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.879090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:18.879148 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.879151 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:35:18.879196 (+ 45us) client_negotiation.cc:240] Negotiation successful
0929 06:35:18.879243 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1256,"thread_start_us":94,"threads_started":1}
I20260929 06:35:18.882046 21164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.872579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43953 (local address 127.0.0.1:52362)
0929 06:35:18.873911 (+ 1332us) negotiation.cc:107] Waiting for socket to connect
0929 06:35:18.873937 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0929 06:35:18.873975 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:35:18.874946 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:35:18.874947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:35:18.874949 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:35:18.874987 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:18.874988 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.879383 (+ 4395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.879384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:18.880494 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:18.880498 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.881741 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.881742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:18.881809 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.881814 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:35:18.881910 (+ 96us) client_negotiation.cc:240] Negotiation successful
0929 06:35:18.881963 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1318,"thread_start_us":72,"threads_started":1}
I20260929 06:35:18.882054 21076 tablet_service.cc:1467] Processing CreateTablet for tablet 4ba74371f98245279c99c812fbbda6ca (DEFAULT_TABLE table=test-table [id=c8b9502ed1b2411f9c31ceb6ad2e4cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:35:18.882493 21076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ba74371f98245279c99c812fbbda6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:35:18.882689 21165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.872334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35254 (local address 127.9.61.66:40577)
0929 06:35:18.873529 (+ 1195us) server_negotiation.cc:206] Beginning negotiation
0929 06:35:18.873533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:35:18.873540 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:35:18.873569 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:35:18.873571 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:35:18.873583 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:35:18.873667 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:35:18.873850 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.876485 (+ 2635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.877952 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.878698 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.878775 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.878856 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 06:35:18.882465 (+ 3609us) server_negotiation.cc:299] Negotiation successful
0929 06:35:18.882520 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1167,"thread_start_us":79,"threads_started":1}
I20260929 06:35:18.883517 20950 tablet_service.cc:1467] Processing CreateTablet for tablet 4ba74371f98245279c99c812fbbda6ca (DEFAULT_TABLE table=test-table [id=c8b9502ed1b2411f9c31ceb6ad2e4cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:35:18.883875 20950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ba74371f98245279c99c812fbbda6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:35:18.888206 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:18.872662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52362 (local address 127.9.61.65:43953)
0929 06:35:18.872877 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0929 06:35:18.872882 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:35:18.874745 (+ 1863us) server_negotiation.cc:407] Connection header received
0929 06:35:18.874787 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:35:18.874789 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:35:18.874804 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:35:18.874878 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:35:18.875063 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.879019 (+ 3956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.880604 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:18.881562 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:18.881647 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:18.881702 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 06:35:18.888056 (+ 6354us) server_negotiation.cc:299] Negotiation successful
0929 06:35:18.888126 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":59,"threads_started":1}
I20260929 06:35:18.888432 21169 tablet_bootstrap.cc:492] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de: Bootstrap starting.
I20260929 06:35:18.888986 20812 tablet_service.cc:1467] Processing CreateTablet for tablet 4ba74371f98245279c99c812fbbda6ca (DEFAULT_TABLE table=test-table [id=c8b9502ed1b2411f9c31ceb6ad2e4cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:35:18.889348 20812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ba74371f98245279c99c812fbbda6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:35:18.889503 21169 tablet_bootstrap.cc:654] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de: Neither blocks nor log segments found. Creating new log.
I20260929 06:35:18.889816 21169 log.cc:824] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de: Log is configured to *not* fsync() on all Append() calls
I20260929 06:35:18.893081 21172 tablet_bootstrap.cc:492] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084: Bootstrap starting.
I20260929 06:35:18.893409 21170 tablet_bootstrap.cc:492] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae: Bootstrap starting.
I20260929 06:35:18.893848 21172 tablet_bootstrap.cc:654] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084: Neither blocks nor log segments found. Creating new log.
I20260929 06:35:18.894495 21172 log.cc:824] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084: Log is configured to *not* fsync() on all Append() calls
I20260929 06:35:18.894840 21170 tablet_bootstrap.cc:654] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae: Neither blocks nor log segments found. Creating new log.
I20260929 06:35:18.895300 21169 tablet_bootstrap.cc:492] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de: No bootstrap required, opened a new log
I20260929 06:35:18.895290 21172 tablet_bootstrap.cc:492] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084: No bootstrap required, opened a new log
I20260929 06:35:18.895375 21172 ts_tablet_manager.cc:1397] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:35:18.895426 21169 ts_tablet_manager.cc:1397] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260929 06:35:18.898130 21172 raft_consensus.cc:348] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 44363 } } peers { permanent_uuid: "04094507e56d47168cf360f28c62b084" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43953 } } peers { permanent_uuid: "585200303bcb4424b47272bbc42b33ae" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40577 } }
I20260929 06:35:18.898130 21169 raft_consensus.cc:348] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 44363 } } peers { permanent_uuid: "04094507e56d47168cf360f28c62b084" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43953 } } peers { permanent_uuid: "585200303bcb4424b47272bbc42b33ae" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40577 } }
I20260929 06:35:18.898301 21169 raft_consensus.cc:374] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:35:18.898301 21172 raft_consensus.cc:374] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:35:18.898340 21169 raft_consensus.cc:729] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ffedf75f2bb4359b7abe0eb17c901de, State: Initialized, Role: FOLLOWER
I20260929 06:35:18.898352 21172 raft_consensus.cc:729] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04094507e56d47168cf360f28c62b084, State: Initialized, Role: FOLLOWER
I20260929 06:35:18.898492 21169 consensus_queue.cc:260] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 44363 } } peers { permanent_uuid: "04094507e56d47168cf360f28c62b084" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43953 } } peers { permanent_uuid: "585200303bcb4424b47272bbc42b33ae" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40577 } }
I20260929 06:35:18.898762 21169 ts_tablet_manager.cc:1428] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:35:18.898898 21151 heartbeater.cc:503] Master 127.9.61.126:32859 was elected leader, sending a full tablet report...
I20260929 06:35:18.900009 21170 log.cc:824] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae: Log is configured to *not* fsync() on all Append() calls
I20260929 06:35:18.902284 21172 consensus_queue.cc:260] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 44363 } } peers { permanent_uuid: "04094507e56d47168cf360f28c62b084" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43953 } } peers { permanent_uuid: "585200303bcb4424b47272bbc42b33ae" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40577 } }
I20260929 06:35:18.902642 21172 ts_tablet_manager.cc:1428] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260929 06:35:18.902666 20879 heartbeater.cc:503] Master 127.9.61.126:32859 was elected leader, sending a full tablet report...
I20260929 06:35:18.904385 21170 tablet_bootstrap.cc:492] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae: No bootstrap required, opened a new log
I20260929 06:35:18.904485 21170 ts_tablet_manager.cc:1397] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20260929 06:35:18.906203 21170 raft_consensus.cc:348] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 44363 } } peers { permanent_uuid: "04094507e56d47168cf360f28c62b084" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43953 } } peers { permanent_uuid: "585200303bcb4424b47272bbc42b33ae" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40577 } }
I20260929 06:35:18.906375 21170 raft_consensus.cc:374] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:35:18.906456 21170 raft_consensus.cc:729] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 585200303bcb4424b47272bbc42b33ae, State: Initialized, Role: FOLLOWER
I20260929 06:35:18.906596 21170 consensus_queue.cc:260] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 44363 } } peers { permanent_uuid: "04094507e56d47168cf360f28c62b084" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43953 } } peers { permanent_uuid: "585200303bcb4424b47272bbc42b33ae" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40577 } }
I20260929 06:35:18.906922 21170 ts_tablet_manager.cc:1428] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260929 06:35:18.906926 21016 heartbeater.cc:503] Master 127.9.61.126:32859 was elected leader, sending a full tablet report...
Sep 29 06:35:18 dist-test-slave-601b krb5kdc[20191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663718, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
W20260929 06:35:19.039078 20880 tablet.cc:2369] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:35:19.049890 21017 tablet.cc:2369] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:35:19.077931 21152 tablet.cc:2369] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:35:19.099479 21174 raft_consensus.cc:482] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:35:19.099641 21174 raft_consensus.cc:504] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 44363 } } peers { permanent_uuid: "04094507e56d47168cf360f28c62b084" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43953 } } peers { permanent_uuid: "585200303bcb4424b47272bbc42b33ae" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40577 } }
I20260929 06:35:19.100128 21174 leader_election.cc:288] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04094507e56d47168cf360f28c62b084 (127.9.61.65:43953), 585200303bcb4424b47272bbc42b33ae (127.9.61.66:40577)
I20260929 06:35:19.104108 21165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:19.100689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:45749 (local address 127.9.61.66:40577)
0929 06:35:19.100754 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:35:19.100756 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:35:19.100772 (+ 16us) server_negotiation.cc:407] Connection header received
0929 06:35:19.100854 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:35:19.100856 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:35:19.100867 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:35:19.100894 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:35:19.101101 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:19.101793 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:19.103164 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:19.103697 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:19.103741 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:19.103753 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0929 06:35:19.103994 (+ 241us) server_negotiation.cc:299] Negotiation successful
0929 06:35:19.104039 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:35:19.104132 21153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:19.100296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43953 (local address 127.9.61.67:42485)
0929 06:35:19.100360 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0929 06:35:19.100383 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0929 06:35:19.100444 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:35:19.100870 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:35:19.100872 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:35:19.100874 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:35:19.100947 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:19.100950 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:19.101902 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:19.101903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:19.103019 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:19.103021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:19.103843 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:19.103844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:19.103916 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:19.103919 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:35:19.104003 (+ 84us) client_negotiation.cc:240] Negotiation successful
0929 06:35:19.104044 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":3}
I20260929 06:35:19.104418 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:19.100528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:42485 (local address 127.9.61.65:43953)
0929 06:35:19.100581 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0929 06:35:19.100583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:35:19.100592 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:35:19.100622 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:35:19.100623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:35:19.100635 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:35:19.100692 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:35:19.101055 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:19.101807 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:19.103153 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:19.103717 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:19.103787 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:19.103811 (+ 24us) server_negotiation.cc:1035] Waiting for connection context
0929 06:35:19.104304 (+ 493us) server_negotiation.cc:299] Negotiation successful
0929 06:35:19.104354 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:35:19.104772 21178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:19.100511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:40577 (local address 127.9.61.67:45749)
0929 06:35:19.100731 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0929 06:35:19.100741 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:35:19.100780 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:35:19.100953 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:35:19.100953 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:35:19.100955 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:35:19.101026 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:19.101028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:19.101911 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:19.101912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:19.103062 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:35:19.103065 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:35:19.103810 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:35:19.103811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:35:19.103872 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:19.103877 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:35:19.104650 (+ 773us) client_negotiation.cc:240] Negotiation successful
0929 06:35:19.104693 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":1,"thread_start_us":89,"threads_started":1}
I20260929 06:35:19.104707 20825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ba74371f98245279c99c812fbbda6ca" candidate_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04094507e56d47168cf360f28c62b084" is_pre_election: true
I20260929 06:35:19.104902 20825 raft_consensus.cc:2454] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ffedf75f2bb4359b7abe0eb17c901de in term 0.
I20260929 06:35:19.105144 21039 leader_election.cc:302] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04094507e56d47168cf360f28c62b084, 2ffedf75f2bb4359b7abe0eb17c901de; no voters:
I20260929 06:35:19.105125 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ba74371f98245279c99c812fbbda6ca" candidate_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "585200303bcb4424b47272bbc42b33ae" is_pre_election: true
I20260929 06:35:19.105271 20970 raft_consensus.cc:2454] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ffedf75f2bb4359b7abe0eb17c901de in term 0.
I20260929 06:35:19.105391 21174 raft_consensus.cc:2781] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:35:19.105448 21174 raft_consensus.cc:482] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:35:19.105470 21174 raft_consensus.cc:3037] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:35:19.106156 21174 raft_consensus.cc:504] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 44363 } } peers { permanent_uuid: "04094507e56d47168cf360f28c62b084" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43953 } } peers { permanent_uuid: "585200303bcb4424b47272bbc42b33ae" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40577 } }
I20260929 06:35:19.106304 21174 leader_election.cc:288] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [CANDIDATE]: Term 1 election: Requested vote from peers 04094507e56d47168cf360f28c62b084 (127.9.61.65:43953), 585200303bcb4424b47272bbc42b33ae (127.9.61.66:40577)
I20260929 06:35:19.106547 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ba74371f98245279c99c812fbbda6ca" candidate_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "585200303bcb4424b47272bbc42b33ae"
I20260929 06:35:19.106549 20825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ba74371f98245279c99c812fbbda6ca" candidate_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04094507e56d47168cf360f28c62b084"
I20260929 06:35:19.106631 20825 raft_consensus.cc:3037] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:35:19.106626 20970 raft_consensus.cc:3037] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:35:19.107461 20825 raft_consensus.cc:2454] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ffedf75f2bb4359b7abe0eb17c901de in term 1.
I20260929 06:35:19.107462 20970 raft_consensus.cc:2454] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ffedf75f2bb4359b7abe0eb17c901de in term 1.
I20260929 06:35:19.107637 21039 leader_election.cc:302] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04094507e56d47168cf360f28c62b084, 2ffedf75f2bb4359b7abe0eb17c901de; no voters:
I20260929 06:35:19.107739 21174 raft_consensus.cc:2781] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:35:19.107921 21174 raft_consensus.cc:686] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 1 LEADER]: Becoming Leader. State: Replica: 2ffedf75f2bb4359b7abe0eb17c901de, State: Running, Role: LEADER
I20260929 06:35:19.108037 21174 consensus_queue.cc:237] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 44363 } } peers { permanent_uuid: "04094507e56d47168cf360f28c62b084" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43953 } } peers { permanent_uuid: "585200303bcb4424b47272bbc42b33ae" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40577 } }
I20260929 06:35:19.108789 20667 catalog_manager.cc:5495] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ffedf75f2bb4359b7abe0eb17c901de (127.9.61.67). New cstate: current_term: 1 leader_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ffedf75f2bb4359b7abe0eb17c901de" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 44363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04094507e56d47168cf360f28c62b084" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "585200303bcb4424b47272bbc42b33ae" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40577 } health_report { overall_health: UNKNOWN } } }
I20260929 06:35:19.162875 21166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:19.159269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41602 (local address 127.9.61.67:44363)
0929 06:35:19.159317 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:35:19.159320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:35:19.159329 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:35:19.159462 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:35:19.159463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:35:19.159487 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:35:19.159562 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:35:19.159742 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:19.160588 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:19.161719 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:35:19.162036 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:35:19.162094 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:35:19.162285 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:35:19.162426 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:35:19.162497 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:35:19.162756 (+ 259us) server_negotiation.cc:299] Negotiation successful
0929 06:35:19.162780 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:35:19.166236 20825 raft_consensus.cc:1261] T 4ba74371f98245279c99c812fbbda6ca P 04094507e56d47168cf360f28c62b084 [term 1 FOLLOWER]: Refusing update from remote peer 2ffedf75f2bb4359b7abe0eb17c901de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:35:19.166232 20970 raft_consensus.cc:1261] T 4ba74371f98245279c99c812fbbda6ca P 585200303bcb4424b47272bbc42b33ae [term 1 FOLLOWER]: Refusing update from remote peer 2ffedf75f2bb4359b7abe0eb17c901de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:35:19.166597 21174 consensus_queue.cc:1035] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [LEADER]: Connected to new peer: Peer: permanent_uuid: "585200303bcb4424b47272bbc42b33ae" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 40577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:35:19.166728 21179 consensus_queue.cc:1035] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [LEADER]: Connected to new peer: Peer: permanent_uuid: "04094507e56d47168cf360f28c62b084" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:35:19.171773 21184 mvcc.cc:205] Tried to move back new op lower bound from 7334558593701904384 to 7334558593466916864. Current Snapshot: MvccSnapshot[applied={T|T < 7334558593701904384}]
I20260929 06:35:19.172160 21182 mvcc.cc:205] Tried to move back new op lower bound from 7334558593701904384 to 7334558593466916864. Current Snapshot: MvccSnapshot[applied={T|T < 7334558593701904384}]
I20260929 06:35:19.174302 21183 mvcc.cc:205] Tried to move back new op lower bound from 7334558593701904384 to 7334558593466916864. Current Snapshot: MvccSnapshot[applied={T|T < 7334558593701904384}]
I20260929 06:35:19.177764 20667 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:35:19.177870 20667 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:35:19.178714 20667 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7029cd12507844809b76796326d88d51: Sending DeleteTablet for 3 replicas of tablet 4ba74371f98245279c99c812fbbda6ca
I20260929 06:35:19.179088 21076 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ba74371f98245279c99c812fbbda6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:35:19 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:41594
I20260929 06:35:19.179139 20950 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ba74371f98245279c99c812fbbda6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:35:19 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:35254
I20260929 06:35:19.179503 20812 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ba74371f98245279c99c812fbbda6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:35:19 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:52362
I20260929 06:35:19.180163 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 20748
W20260929 06:35:19.186220 20652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:43953 (error 108)
I20260929 06:35:19.186887 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 20885
I20260929 06:35:19.197829 21191 tablet_replica.cc:330] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de: stopping tablet replica
I20260929 06:35:19.198007 21191 raft_consensus.cc:2229] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:35:19.198173 21191 raft_consensus.cc:2258] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:35:19.198766 21191 ts_tablet_manager.cc:1905] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:35:19.200444 21164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:19.200280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43953 (local address 127.0.0.1:52364)
0929 06:35:19.200342 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0929 06:35:19.200402 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:43953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 06:35:19.200803 21191 ts_tablet_manager.cc:1918] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260929 06:35:19.200762 20652 catalog_manager.cc:4584] TS 04094507e56d47168cf360f28c62b084 (127.9.61.65:43953): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4ba74371f98245279c99c812fbbda6ca: Network error: Client connection negotiation failed: client connection to 127.9.61.65:43953: connect: Connection refused (error 111)
I20260929 06:35:19.200870 21191 log.cc:1196] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/4ba74371f98245279c99c812fbbda6ca
I20260929 06:35:19.201144 21191 ts_tablet_manager.cc:1939] T 4ba74371f98245279c99c812fbbda6ca P 2ffedf75f2bb4359b7abe0eb17c901de: Deleting consensus metadata
I20260929 06:35:19.201215 21164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:19.200614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:40577 (local address 127.0.0.1:35258)
0929 06:35:19.201135 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0929 06:35:19.201183 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.66:40577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499}
I20260929 06:35:19.201357 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 21021
I20260929 06:35:19.208226 21164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:35:19.208123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:44363 (local address 127.0.0.1:41614)
0929 06:35:19.208156 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0929 06:35:19.208182 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.67:44363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
I20260929 06:35:19.208544 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 20635
I20260929 06:35:19.214674 9461 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260929 06:35:19.559828 9461 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260929 06:35:19.559932 9461 mini_ranger.cc:66] Stopping Ranger...
I20260929 06:35:19.904755 9461 mini_ranger.cc:68] Stopped Ranger
2026-09-29 06:35:19.905 UTC [20221] LOG: received smart shutdown request
2026-09-29 06:35:19.908 UTC [20221] LOG: background worker "logical replication launcher" (PID 20230) exited with exit code 1
2026-09-29 06:35:19.909 UTC [20225] LOG: shutting down
2026-09-29 06:35:20.080 UTC [20221] LOG: database system is shut down
2026-09-29T06:35:20Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (45144 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:35:20 dist-test-slave-601b krb5kdc[21203](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:35:20 dist-test-slave-601b krb5kdc[21203](info): set up 2 sockets
Sep 29 06:35:20 dist-test-slave-601b krb5kdc[21203](info): commencing operation
krb5kdc: starting...
W20260929 06:35:21.231853 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:35:21 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:35:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:35:21Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.9.61.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.9.61.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/rangeradmin_127.9.61.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/rangeradmin_127.9.61.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.9.61.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.9.61.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/rangerlookup_127.9.61.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/rangerlookup_127.9.61.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.61.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.9.61.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/HTTP_127.9.61.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/HTTP_127.9.61.84@KRBTEST.COM.keytab.
I20260929 06:35:21.394625 9461 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskA6qGeu/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/postgres -l logfile start
2026-09-29 06:35:23.915 UTC [21233] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-29 06:35:23.915 UTC [21233] LOG: listening on IPv4 address "127.9.61.84", port 58879
2026-09-29 06:35:23.918 UTC [21233] LOG: listening on Unix socket "/tmp/.s.PGSQL.58879"
2026-09-29 06:35:23.952 UTC [21236] LOG: database system was shut down at 2026-09-29 06:35:22 UTC
2026-09-29 06:35:23.956 UTC [21233] LOG: database system is ready to accept connections
I20260929 06:35:24.903694 9461 mini_postgres.cc:96] Postgres bound to 58879
2026-09-29 06:35:24.909 UTC [21244] FATAL: database "slave" does not exist
127.9.61.84:58879 - accepting connections
I20260929 06:35:24.910094 9461 mini_ranger.cc:161] Starting Ranger...
I20260929 06:35:24.924443 9461 mini_ranger.cc:84] Created miniranger Postgres user
I20260929 06:35:25.398020 9461 mini_ranger.cc:87] Created ranger Postgres database
I20260929 06:35:25.398092 9461 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-admin
2026-09-29 06:35:25,659 [I] DB FLAVOR :POSTGRES
2026-09-29 06:35:25,659 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 06:35:25,660 [I] Checking connection..
2026-09-29 06:35:25,660 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-29 06:35:25,910 [I] Checking connection passed.
2026-09-29 06:35:25,911 [I] --------- Verifying version history table ---------
2026-09-29 06:35:25,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 06:35:26,169 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 06:35:26,170 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 06:35:26,401 [I] Table x_db_version_h does not exist in database ranger
2026-09-29 06:35:26,401 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-29 06:35:26,402 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-29 06:35:26.645 UTC [21308] WARNING: there is no transaction in progress
2026-09-29 06:35:26,651 [I] create_dbversion_catalog.sql file imported successfully
2026-09-29 06:35:26,652 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-29 06:35:26,888 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-29 06:35:26,888 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 06:35:26,888 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-29 06:35:27,145 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-29 06:35:27,392 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-601b.c.gcp-upstream.internal','N') ;"
2026-09-29 06:35:27,607 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 06:35:27,864 [I] Table x_portal_user does not exist in database ranger
2026-09-29 06:35:27,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 06:35:28,110 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-29 06:35:28,110 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 06:35:28,361 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 06:35:28,605 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-29 06:35:28,605 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-29 06:35:29.562 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.579 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.596 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.611 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.627 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.644 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.698 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.705 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.720 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.731 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.742 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.758 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.768 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.775 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.782 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:29.790 UTC [21416] WARNING: there is no transaction in progress
2026-09-29 06:35:30,406 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-29 06:35:30,407 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-29 06:35:30,638 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-29 06:35:30,639 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-29 06:35:30,896 [I] Table x_portal_user already exists in database 'ranger'
2026-09-29 06:35:30,896 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-29 06:35:31,140 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-29 06:35:31,141 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-29 06:35:31,395 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-29 06:35:31,631 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-601b.c.gcp-upstream.internal';"
2026-09-29 06:35:31,880 [I] CORE_DB_SCHEMA import status has been updated
2026-09-29 06:35:31,881 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-29 06:35:32,108 [I] DB_PATCHES have already been applied
I20260929 06:35:32.115058 9461 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-admin:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskA6qGeu/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260929 06:35:32.115136 9461 mini_ranger.cc:193] Using host: 127.9.61.84
I20260929 06:35:32.118142 9461 mini_ranger.cc:227] Ranger admin URL: http://127.9.61.84:34743
Sep 29, 2026 6:35:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 6:35:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 6:35:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-admin/ews/webapp
Sep 29, 2026 6:35:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 29, 2026 6:35:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 29, 2026 6:35:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-admin/ews/webapp].
Sep 29, 2026 6:35:32 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260929 06:35:33.221191 9461 mini_ranger.cc:160] Time spent starting Ranger: real 8.311s user 0.000s sys 0.008s
Sep 29, 2026 6:35:52 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 29, 2026 6:35:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Sep 29, 2026 6:35:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 29, 2026 6:35:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 29, 2026 6:35:52 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 29, 2026 6:35:53 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260929 06:35:53.654426 9461 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.9.61.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.9.61.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/rangerkms_127.9.61.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.9.61.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/rangerkms_127.9.61.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.61.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.9.61.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.61.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/HTTP_127.9.61.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.61.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/HTTP_127.9.61.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 29 06:35:53 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663753, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260929 06:35:53.736182 9461 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260929 06:35:53.745609 9461 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260929 06:35:54.611032 9461 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260929 06:35:54.611119 9461 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-kms
I20260929 06:35:54.611135 9461 mini_ranger_kms.cc:227] Using postgres at 127.9.61.84:58879
2026-09-29 06:35:54,799 [I] DB FLAVOR :POSTGRES
2026-09-29 06:35:54,800 [I] --------- Verifying Ranger DB connection ---------
2026-09-29 06:35:54,800 [I] Checking connection
2026-09-29 06:35:54,800 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-29 06:35:55,067 [I] connection success
2026-09-29 06:35:55,068 [I] --------- Verifying Ranger DB tables ---------
2026-09-29 06:35:55,068 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-29 06:35:55,068 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-29 06:35:55,336 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-29 06:35:55,336 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-29 06:35:55,337 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-29 06:35:55,337 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.61.84:58879/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-29 06:35:55,622 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260929 06:35:56.098102 9461 mini_ranger_kms.cc:310] Created kms service
I20260929 06:35:56.303292 9461 mini_ranger_kms.cc:326] Created kudu user
I20260929 06:35:56.349051 9461 mini_ranger_kms.cc:343] Created rangerkms user
Sep 29 06:35:56 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663753, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:35:56.734089 9461 mini_ranger_kms.cc:384] Added ranger policy
I20260929 06:35:56.734205 9461 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-kms:/tmp/dist-test-taskA6qGeu/build/release/bin/postgresql.jar:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskA6qGeu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260929 06:35:56.734223 9461 mini_ranger_kms.cc:240] Using host: 127.9.61.84
I20260929 06:35:56.737993 9461 mini_ranger_kms.cc:276] Ranger KMS PID: 21596
I20260929 06:35:56.738085 9461 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.9.61.84:46711
Sep 29, 2026 6:35:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 29, 2026 6:35:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 29, 2026 6:35:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 29, 2026 6:35:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 29, 2026 6:35:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-kms/ews/webapp].
Sep 29, 2026 6:35:58 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260929 06:35:59.021660 9461 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.285s user 0.000s sys 0.171s
I20260929 06:35:59.021765 9461 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260929 06:35:59.021814 9461 mini_ranger_kms.cc:401] 127.9.61.84:46711/kms/v1/keys
Sep 29 06:35:59 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790663759, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.61.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 29 06:35:59 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663759, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.61.84@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
Sep 29 06:36:00 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663759, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.61.84@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
Sep 29 06:36:02 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:36:02.619398 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41937
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:41937
--ranger_config_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.61.84:46711/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:02.713294 21647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:02.713493 21647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:02.713515 21647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:02.714648 21647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:36:02.714691 21647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:02.714706 21647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:02.714718 21647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:36:02.714780 21647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:36:02.716323 21647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/wal
--ranger_kms_url=127.9.61.84:46711/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:41937
--ranger_config_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:02.716567 21647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:02.716794 21647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:02.721745 21655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:02.721774 21647 server_base.cc:1034] running on GCE node
W20260929 06:36:02.721840 21652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:02.721890 21653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:02.722154 21647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:02.722404 21647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:02.723569 21647 hybrid_clock.cc:648] HybridClock initialized: now 1790663762723549 us; error 40 us; skew 500 ppm
Sep 29 06:36:02 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663762, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:02.726210 21647 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:36:02.726723 21647 webserver.cc:460] Webserver started at http://127.9.61.126:43551/ using document root <none> and password file <none>
I20260929 06:36:02.726912 21647 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:02.726948 21647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:02.727034 21647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:36:02 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663762, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:36:02.779768 21647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "11ab81968701443d9da55b2fbc9ef960"
format_stamp: "Formatted at 2026-09-29 06:36:02 on dist-test-slave-601b"
server_key: "d52ae526d115481ebdb9ea0f7f9a5be2"
server_key_iv: "d3d52daa16ba0537cd173b6e94fa771b"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:02.780267 21647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "11ab81968701443d9da55b2fbc9ef960"
format_stamp: "Formatted at 2026-09-29 06:36:02 on dist-test-slave-601b"
server_key: "d52ae526d115481ebdb9ea0f7f9a5be2"
server_key_iv: "d3d52daa16ba0537cd173b6e94fa771b"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:02.781709 21647 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:02.793566 21662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:02.793748 21647 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:36:02.793869 21647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "11ab81968701443d9da55b2fbc9ef960"
format_stamp: "Formatted at 2026-09-29 06:36:02 on dist-test-slave-601b"
server_key: "d52ae526d115481ebdb9ea0f7f9a5be2"
server_key_iv: "d3d52daa16ba0537cd173b6e94fa771b"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:02.793980 21647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:02.815241 21647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:02.817469 21647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:02.817639 21647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:02.822456 21647 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:41937
I20260929 06:36:02.822536 21714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:41937 every 8 connection(s)
I20260929 06:36:02.822894 21647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:36:02.823598 21715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:02.825697 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 21647
I20260929 06:36:02.825798 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:36:02.825992 9461 external_mini_cluster.cc:1428] Setting key ff00cf0cfb3f62349793c02555b071c8
I20260929 06:36:02.825982 21715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960: Bootstrap starting.
I20260929 06:36:02.826738 21715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:02.827037 21715 log.cc:824] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:02.827780 21715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960: No bootstrap required, opened a new log
I20260929 06:36:02.829797 21715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ab81968701443d9da55b2fbc9ef960" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41937 } }
I20260929 06:36:02.829978 21715 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:02.830016 21715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ab81968701443d9da55b2fbc9ef960, State: Initialized, Role: FOLLOWER
I20260929 06:36:02.830178 21715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ab81968701443d9da55b2fbc9ef960" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41937 } }
I20260929 06:36:02.830260 21715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:36:02.830292 21715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:36:02.830374 21715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:02.831025 21715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ab81968701443d9da55b2fbc9ef960" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41937 } }
I20260929 06:36:02.831146 21715 leader_election.cc:302] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11ab81968701443d9da55b2fbc9ef960; no voters:
I20260929 06:36:02.831302 21715 leader_election.cc:288] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:36:02.831331 21720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:36:02.831542 21720 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 1 LEADER]: Becoming Leader. State: Replica: 11ab81968701443d9da55b2fbc9ef960, State: Running, Role: LEADER
I20260929 06:36:02.832027 21720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ab81968701443d9da55b2fbc9ef960" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41937 } }
I20260929 06:36:02.832429 21720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11ab81968701443d9da55b2fbc9ef960. Latest consensus state: current_term: 1 leader_uuid: "11ab81968701443d9da55b2fbc9ef960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ab81968701443d9da55b2fbc9ef960" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41937 } } }
I20260929 06:36:02.832661 21720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:02.832590 21721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11ab81968701443d9da55b2fbc9ef960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ab81968701443d9da55b2fbc9ef960" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41937 } } }
I20260929 06:36:02.833101 21721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:02.833194 21724 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:36:02.831660 21715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:36:02.833698 21724 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 29 06:36:02 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:02.834834 21715 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260929 06:36:02.835425 21724 catalog_manager.cc:1347] Generated new cluster ID: 53e41f0356a0412a90d47e3584b13d4b
I20260929 06:36:02.835474 21724 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:36:02.843988 21718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:02.826547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35120 (local address 127.9.61.126:41937)
0929 06:36:02.826732 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:02.826742 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:02.826775 (+ 33us) server_negotiation.cc:407] Connection header received
0929 06:36:02.827317 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:02.827327 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:02.827386 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:02.827536 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:02.828384 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:02.829805 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:02.830924 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:02.831548 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:02.831650 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:02.834614 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:02.834618 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:02.834618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:02.834631 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:02.841352 (+ 6721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:02.841843 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:02.841846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:02.841847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:02.841988 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:02.842246 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:02.842247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:02.842247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:02.842684 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:02.842860 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:02.843352 (+ 492us) server_negotiation.cc:299] Negotiation successful
0929 06:36:02.843668 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":75,"threads_started":1}
I20260929 06:36:02.848037 21724 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:36:02.848790 21724 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:36:02.855609 21724 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960: Generated new TSK 0
I20260929 06:36:02.855881 21724 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:36:03.574620 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.61.84:46711/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41937
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:03.679420 21760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:03.679606 21760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:03.679629 21760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:03.680778 21760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:03.680867 21760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:03.680912 21760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:36:03.682446 21760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.9.61.84:46711/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21760
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:03.682704 21760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:03.682976 21760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:03.687989 21768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:03.688005 21765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:03.688187 21760 server_base.cc:1034] running on GCE node
W20260929 06:36:03.688308 21766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:03.688488 21760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:03.688745 21760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:03.691999 21760 hybrid_clock.cc:648] HybridClock initialized: now 1790663763691981 us; error 34 us; skew 500 ppm
Sep 29 06:36:03 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663763, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:03.695372 21760 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:36:03.695917 21760 webserver.cc:460] Webserver started at http://127.9.61.65:39213/ using document root <none> and password file <none>
I20260929 06:36:03.696213 21760 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:03.696254 21760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:03.696343 21760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:36:03 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663763, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:36:03.712368 21760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "598c3f572fc94cb7a9376877d5f46c1a"
format_stamp: "Formatted at 2026-09-29 06:36:03 on dist-test-slave-601b"
server_key: "81553236a3144fb167937cd785f8e414"
server_key_iv: "504a91a8ab6c068f1d68ac9ad32ffb02"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:03.712944 21760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "598c3f572fc94cb7a9376877d5f46c1a"
format_stamp: "Formatted at 2026-09-29 06:36:03 on dist-test-slave-601b"
server_key: "81553236a3144fb167937cd785f8e414"
server_key_iv: "504a91a8ab6c068f1d68ac9ad32ffb02"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:03.716750 21760 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.000s
I20260929 06:36:03.732105 21777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:03.732380 21760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260929 06:36:03.732494 21760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "598c3f572fc94cb7a9376877d5f46c1a"
format_stamp: "Formatted at 2026-09-29 06:36:03 on dist-test-slave-601b"
server_key: "81553236a3144fb167937cd785f8e414"
server_key_iv: "504a91a8ab6c068f1d68ac9ad32ffb02"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:03.732604 21760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:03.751366 21760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:03.754129 21760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:03.754328 21760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:03.754570 21760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:03.755007 21760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:03.755062 21760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:03.755096 21760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:03.755153 21760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:03.763336 21760 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:38627
I20260929 06:36:03.763397 21890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:38627 every 8 connection(s)
I20260929 06:36:03.763876 21760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:36:03 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663763, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:03.773890 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 21760
I20260929 06:36:03.774034 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:36:03.774225 9461 external_mini_cluster.cc:1428] Setting key ab7f181c893e659b4db956fdafd2ce3e
I20260929 06:36:03.778450 21894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:03.764669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41937 (local address 127.9.61.65:37581)
0929 06:36:03.764973 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:03.765017 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:03.765636 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:03.767455 (+ 1819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:03.767460 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:03.767759 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:03.768140 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:03.768148 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:03.769344 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:03.769346 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:03.770719 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:03.770722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:03.771350 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:03.771351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:03.771500 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:03.772236 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:03.772247 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:03.774094 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:03.776506 (+ 2412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:03.776515 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:03.776518 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:03.776873 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:03.777139 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:03.777140 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:03.777140 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:03.777314 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:03.777650 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:03.777657 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:03.777859 (+ 202us) client_negotiation.cc:769] Sending connection context
0929 06:36:03.777983 (+ 124us) client_negotiation.cc:240] Negotiation successful
0929 06:36:03.778157 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":111,"threads_started":1}
I20260929 06:36:03.779074 21893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:03.764676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:37581 (local address 127.9.61.126:41937)
0929 06:36:03.767155 (+ 2479us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:03.767157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:03.767169 (+ 12us) server_negotiation.cc:407] Connection header received
0929 06:36:03.767201 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:03.767202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:03.767216 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:03.767301 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:03.768264 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:03.769192 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:03.770837 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:03.771182 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:03.771249 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:03.774188 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:03.774189 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:03.774190 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:03.774199 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:03.776396 (+ 2197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:03.776976 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:03.776977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:03.776977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:03.777057 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:03.777400 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:03.777401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:03.777402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:03.777560 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:03.777623 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:03.778865 (+ 1242us) server_negotiation.cc:299] Negotiation successful
0929 06:36:03.778963 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2445,"thread_start_us":105,"threads_started":1}
I20260929 06:36:03.779903 21891 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41937
I20260929 06:36:03.780046 21891 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:03.780257 21891 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
I20260929 06:36:03.780923 21679 ts_manager.cc:194] Registered new tserver with Master: 598c3f572fc94cb7a9376877d5f46c1a (127.9.61.65:38627)
I20260929 06:36:03.781919 21679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:37581
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:36:03.825018 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.61.84:46711/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41937
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:36:03 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790663763, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260929 06:36:03.957446 21899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:03.957720 21899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:03.957763 21899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:03.959233 21899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:03.959327 21899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:03.959380 21899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:36:03.961272 21899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.9.61.84:46711/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:03.961573 21899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:03.961838 21899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:03.968138 21904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:03.968138 21905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:03.968240 21907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:03.968441 21899 server_base.cc:1034] running on GCE node
I20260929 06:36:03.968632 21899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:03.968891 21899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:03.970084 21899 hybrid_clock.cc:648] HybridClock initialized: now 1790663763970075 us; error 34 us; skew 500 ppm
Sep 29 06:36:03 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663763, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:03.973001 21899 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:36:03.973462 21899 webserver.cc:460] Webserver started at http://127.9.61.66:41191/ using document root <none> and password file <none>
I20260929 06:36:03.973712 21899 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:03.973783 21899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:03.973937 21899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:36:03 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663763, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:36:03.992220 21899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "cc357b69811a46888c088171441335a3"
format_stamp: "Formatted at 2026-09-29 06:36:03 on dist-test-slave-601b"
server_key: "730dc5ce62107361c9b6397432965966"
server_key_iv: "31bdcc5d3de5259066066293a3bb595c"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:03.993021 21899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "cc357b69811a46888c088171441335a3"
format_stamp: "Formatted at 2026-09-29 06:36:03 on dist-test-slave-601b"
server_key: "730dc5ce62107361c9b6397432965966"
server_key_iv: "31bdcc5d3de5259066066293a3bb595c"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:04.006461 21899 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.002s sys 0.000s
I20260929 06:36:04.026955 21915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:04.027225 21899 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260929 06:36:04.027323 21899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "cc357b69811a46888c088171441335a3"
format_stamp: "Formatted at 2026-09-29 06:36:03 on dist-test-slave-601b"
server_key: "730dc5ce62107361c9b6397432965966"
server_key_iv: "31bdcc5d3de5259066066293a3bb595c"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:04.027426 21899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:04.053673 21899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:04.056025 21899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:04.056190 21899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:04.056480 21899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:04.056914 21899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:04.057008 21899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:04.057082 21899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:04.057112 21899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:04.063385 21899 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:44961
I20260929 06:36:04.063930 21899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:36:04.064687 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 21899
I20260929 06:36:04.064806 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:36:04.065042 9461 external_mini_cluster.cc:1428] Setting key 5927efe4483a594be39c135e18bc734c
I20260929 06:36:04.066915 22028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:44961 every 8 connection(s)
Sep 29 06:36:04 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663763, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:04.082630 21893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:04.067859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:59233 (local address 127.9.61.126:41937)
0929 06:36:04.067908 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:04.067910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:04.068273 (+ 363us) server_negotiation.cc:407] Connection header received
0929 06:36:04.068965 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:04.068967 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:04.068979 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:04.069011 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:04.069886 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:04.070679 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:04.072206 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:04.072516 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:04.072561 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:04.077854 (+ 5293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:04.077856 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:04.077857 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:04.077865 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:04.079851 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:04.081276 (+ 1425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:04.081278 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:04.081278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:04.081355 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:04.081675 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:04.081676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:04.081676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:04.081832 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:04.081888 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:04.082306 (+ 418us) server_negotiation.cc:299] Negotiation successful
0929 06:36:04.082477 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
I20260929 06:36:04.083550 22032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:04.067573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41937 (local address 127.9.61.66:59233)
0929 06:36:04.068141 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:04.068188 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:04.068838 (+ 650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:04.069200 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:04.069205 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:04.069464 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:04.069751 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:04.069758 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:04.070801 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:04.070801 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:04.072100 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:04.072103 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:04.072664 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:04.072665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:04.072804 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:04.075854 (+ 3050us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:04.075866 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:04.077700 (+ 1834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:04.080812 (+ 3112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:04.080822 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:04.080825 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:04.081165 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:04.081430 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:04.081431 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:04.081432 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:04.081591 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:04.081924 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:04.081929 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:04.082131 (+ 202us) client_negotiation.cc:769] Sending connection context
0929 06:36:04.083039 (+ 908us) client_negotiation.cc:240] Negotiation successful
0929 06:36:04.083228 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":79,"threads_started":1}
I20260929 06:36:04.084280 22029 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41937
I20260929 06:36:04.084383 22029 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:04.084573 22029 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
I20260929 06:36:04.085122 21679 ts_manager.cc:194] Registered new tserver with Master: cc357b69811a46888c088171441335a3 (127.9.61.66:44961)
I20260929 06:36:04.085628 21679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:59233
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:36:04.120674 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.61.84:46711/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41937
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:04.244307 22034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:04.244652 22034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:04.244735 22034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:04.246382 22034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:04.246481 22034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:04.246557 22034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:36:04.248739 22034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.9.61.84:46711/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:04.248993 22034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:04.249387 22034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:36:04.256615 22034 server_base.cc:1034] running on GCE node
W20260929 06:36:04.257368 22040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:04.257570 22039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:04.259631 22042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:04.260385 22034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:04.260705 22034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:04.261907 22034 hybrid_clock.cc:648] HybridClock initialized: now 1790663764261881 us; error 43 us; skew 500 ppm
Sep 29 06:36:04 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663764, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:04.265515 22034 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:36:04.266088 22034 webserver.cc:460] Webserver started at http://127.9.61.67:43899/ using document root <none> and password file <none>
I20260929 06:36:04.266355 22034 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:04.266407 22034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:04.266538 22034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 29 06:36:04 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663764, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:36:04.291188 22034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37"
format_stamp: "Formatted at 2026-09-29 06:36:04 on dist-test-slave-601b"
server_key: "1ce2fbbf73f4d63956df88156704f7a6"
server_key_iv: "493e264621fd14a135eb911bfdf9c0b2"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:04.291778 22034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37"
format_stamp: "Formatted at 2026-09-29 06:36:04 on dist-test-slave-601b"
server_key: "1ce2fbbf73f4d63956df88156704f7a6"
server_key_iv: "493e264621fd14a135eb911bfdf9c0b2"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:04.305837 22034 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.001s sys 0.001s
I20260929 06:36:04.319571 22049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:04.319852 22034 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260929 06:36:04.319973 22034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37"
format_stamp: "Formatted at 2026-09-29 06:36:04 on dist-test-slave-601b"
server_key: "1ce2fbbf73f4d63956df88156704f7a6"
server_key_iv: "493e264621fd14a135eb911bfdf9c0b2"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:04.320068 22034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:04.342172 22034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:04.344823 22034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:04.345043 22034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:04.345325 22034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:04.345731 22034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:04.345834 22034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:04.345914 22034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:04.345976 22034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:04.354453 22034 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:41409
I20260929 06:36:04.354977 22034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:36:04.355417 22162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:41409 every 8 connection(s)
I20260929 06:36:04.360256 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 22034
I20260929 06:36:04.360371 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:36:04.360569 9461 external_mini_cluster.cc:1428] Setting key 36c8d19559defc137cf5a23f4d2edd8c
Sep 29 06:36:04 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663764, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:04.369853 21893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:04.356651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:55055 (local address 127.9.61.126:41937)
0929 06:36:04.356703 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:04.356705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:04.357130 (+ 425us) server_negotiation.cc:407] Connection header received
0929 06:36:04.357869 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:04.357870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:04.357882 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:04.357916 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:04.358746 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:04.359518 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:04.361175 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:04.361462 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:04.361510 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:04.364133 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:04.364134 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:04.364135 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:04.364142 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:04.365886 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:04.368684 (+ 2798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:04.368685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:04.368686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:04.368748 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:04.369061 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:04.369062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:04.369062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:04.369204 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:04.369258 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:04.369654 (+ 396us) server_negotiation.cc:299] Negotiation successful
0929 06:36:04.369739 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260929 06:36:04.370761 22165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:04.356364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41937 (local address 127.9.61.67:55055)
0929 06:36:04.356998 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:04.357044 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:04.357722 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:04.358107 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:04.358112 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:04.358357 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:04.358630 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:04.358637 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:04.359635 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:04.359635 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:04.361061 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:04.361064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:04.361622 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:04.361623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:04.361751 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:04.362346 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:04.362357 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:04.364023 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:04.365982 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:04.368244 (+ 2262us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:04.368248 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:04.368584 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:04.368837 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:04.368837 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:04.368838 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:04.368978 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:04.369295 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:04.369302 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:04.369491 (+ 189us) client_negotiation.cc:769] Sending connection context
0929 06:36:04.370351 (+ 860us) client_negotiation.cc:240] Negotiation successful
0929 06:36:04.370521 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":78,"threads_started":1}
I20260929 06:36:04.371662 22163 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41937
I20260929 06:36:04.371755 22163 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:04.371969 22163 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
I20260929 06:36:04.372612 21679 ts_manager.cc:194] Registered new tserver with Master: d8aea0c2b7bf47d397e3c1e2c55f7e37 (127.9.61.67:41409)
I20260929 06:36:04.373530 21679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:55055
I20260929 06:36:04.382939 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:36:04.383774 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 21760
I20260929 06:36:04.392992 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 21899
I20260929 06:36:04.398857 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 22034
I20260929 06:36:04.404498 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 21647
I20260929 06:36:04.416360 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41937
--webserver_interface=127.9.61.126
--webserver_port=43551
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:41937
--ranger_config_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.61.84:46711/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.61.84:46711/kms with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:04.503454 22166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:04.503687 22166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:04.503724 22166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:04.504925 22166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:36:04.504992 22166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:04.505018 22166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:04.505048 22166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:36:04.505075 22166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:36:04.506630 22166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.61.84:46711/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:41937
--ranger_config_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=43551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:04.506901 22166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:04.507119 22166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:04.512596 22172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:04.512605 22171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:04.512671 22174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:04.512830 22166 server_base.cc:1034] running on GCE node
I20260929 06:36:04.513118 22166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:04.513412 22166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:04.514590 22166 hybrid_clock.cc:648] HybridClock initialized: now 1790663764514569 us; error 39 us; skew 500 ppm
Sep 29 06:36:04 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663764, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:04.517269 22166 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:36:04.517776 22166 webserver.cc:460] Webserver started at http://127.9.61.126:43551/ using document root <none> and password file <none>
I20260929 06:36:04.518013 22166 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:04.518087 22166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 06:36:04 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663764, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:36:04.574496 22166 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:04.575300 22182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:04.575508 22166 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:04.575625 22166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "11ab81968701443d9da55b2fbc9ef960"
format_stamp: "Formatted at 2026-09-29 06:36:02 on dist-test-slave-601b"
server_key: "d52ae526d115481ebdb9ea0f7f9a5be2"
server_key_iv: "d3d52daa16ba0537cd173b6e94fa771b"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:04.576139 22166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:04.595815 22166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:04.598071 22166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:04.598193 22166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:04.602495 22166 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:41937
I20260929 06:36:04.602535 22234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:41937 every 8 connection(s)
I20260929 06:36:04.602958 22166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:36:04.604362 22235 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:36:04.605057 22235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960: Bootstrap starting.
I20260929 06:36:04.613164 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 22166
I20260929 06:36:04.613523 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.61.84:46711/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:38627
--local_ip_for_outbound_sockets=127.9.61.65
--tserver_master_addrs=127.9.61.126:41937
--webserver_port=39213
--webserver_interface=127.9.61.65
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.61.84:46711/kms with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:36:04.613603 22235 log.cc:824] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:04.615712 22235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:36:04.616097 22235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960: Bootstrap complete.
I20260929 06:36:04.618667 22235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ab81968701443d9da55b2fbc9ef960" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41937 } }
I20260929 06:36:04.618928 22235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ab81968701443d9da55b2fbc9ef960, State: Initialized, Role: FOLLOWER
I20260929 06:36:04.619102 22235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ab81968701443d9da55b2fbc9ef960" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41937 } }
I20260929 06:36:04.619179 22235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:36:04.619249 22235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:36:04.619302 22235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 1 FOLLOWER]: Advancing to term 2
I20260929 06:36:04.620543 22235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ab81968701443d9da55b2fbc9ef960" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41937 } }
I20260929 06:36:04.620645 22235 leader_election.cc:302] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11ab81968701443d9da55b2fbc9ef960; no voters:
I20260929 06:36:04.620918 22235 leader_election.cc:288] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 06:36:04.620959 22239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 06:36:04.621096 22239 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [term 2 LEADER]: Becoming Leader. State: Replica: 11ab81968701443d9da55b2fbc9ef960, State: Running, Role: LEADER
I20260929 06:36:04.621197 22239 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ab81968701443d9da55b2fbc9ef960" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41937 } }
I20260929 06:36:04.621258 22235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:36:04.621551 22241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11ab81968701443d9da55b2fbc9ef960. Latest consensus state: current_term: 2 leader_uuid: "11ab81968701443d9da55b2fbc9ef960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ab81968701443d9da55b2fbc9ef960" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41937 } } }
I20260929 06:36:04.621809 22241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:04.621846 22240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "11ab81968701443d9da55b2fbc9ef960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ab81968701443d9da55b2fbc9ef960" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41937 } } }
I20260929 06:36:04.621941 22240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:04.622177 22249 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:36:04.622788 22249 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:36:04.623000 22249 catalog_manager.cc:1259] Loaded cluster ID: 53e41f0356a0412a90d47e3584b13d4b
I20260929 06:36:04.623050 22249 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:36:04.623304 22235 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260929 06:36:04.624591 22249 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:36:04.624764 22249 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960: Loaded TSK: 0
I20260929 06:36:04.624982 22249 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 06:36:04.729820 22238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:04.730110 22238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:04.730149 22238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:04.732009 22238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:04.732137 22238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:04.732228 22238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:36:04.734608 22238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.61.84:46711/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:38627
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=39213
--tserver_master_addrs=127.9.61.126:41937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:04.734910 22238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:04.735167 22238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:04.740983 22272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:04.741242 22273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:04.741087 22275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:04.742159 22238 server_base.cc:1034] running on GCE node
I20260929 06:36:04.742465 22238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:04.742754 22238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:04.743916 22238 hybrid_clock.cc:648] HybridClock initialized: now 1790663764743884 us; error 47 us; skew 500 ppm
Sep 29 06:36:04 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663764, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:04.746582 22238 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:36:04.747110 22238 webserver.cc:460] Webserver started at http://127.9.61.65:39213/ using document root <none> and password file <none>
I20260929 06:36:04.747375 22238 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:04.747465 22238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 06:36:04 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663764, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:36:04.773329 22238 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260929 06:36:04.779228 22283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:04.779598 22238 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260929 06:36:04.779734 22238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "598c3f572fc94cb7a9376877d5f46c1a"
format_stamp: "Formatted at 2026-09-29 06:36:03 on dist-test-slave-601b"
server_key: "81553236a3144fb167937cd785f8e414"
server_key_iv: "504a91a8ab6c068f1d68ac9ad32ffb02"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:04.780223 22238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:04.805449 22238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:04.807580 22238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:04.807735 22238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:04.808058 22238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:04.808416 22238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:04.808482 22238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:04.808531 22238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:04.808563 22238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:04.816030 22238 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:38627
I20260929 06:36:04.816180 22396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:38627 every 8 connection(s)
I20260929 06:36:04.816540 22238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:36:04.820096 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 22238
I20260929 06:36:04.820406 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.61.84:46711/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:44961
--local_ip_for_outbound_sockets=127.9.61.66
--tserver_master_addrs=127.9.61.126:41937
--webserver_port=41191
--webserver_interface=127.9.61.66
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.61.84:46711/kms with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:36:04 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663764, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:04.832186 22399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:04.818875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41937 (local address 127.9.61.65:46415)
0929 06:36:04.819137 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:04.819184 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:04.819846 (+ 662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:04.820648 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:04.820653 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:04.820900 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:04.821198 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:04.821204 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:04.822997 (+ 1793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:04.822998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:04.824301 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:04.824305 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:04.825222 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:04.825223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:04.825382 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:04.826013 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:04.826024 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:04.827678 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:04.830127 (+ 2449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:04.830134 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:04.830137 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:04.830471 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:04.830785 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:04.830786 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:04.830786 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:04.830921 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:04.831423 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:04.831430 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:04.831611 (+ 181us) client_negotiation.cc:769] Sending connection context
0929 06:36:04.831712 (+ 101us) client_negotiation.cc:240] Negotiation successful
0929 06:36:04.831905 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":77,"threads_started":1}
I20260929 06:36:04.833115 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:04.818983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:46415 (local address 127.9.61.126:41937)
0929 06:36:04.820127 (+ 1144us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:04.820137 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:04.820181 (+ 44us) server_negotiation.cc:407] Connection header received
0929 06:36:04.820342 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:04.820349 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:04.820414 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:04.821340 (+ 926us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:04.821454 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:04.822869 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:04.824429 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:04.825088 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:04.825685 (+ 597us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:04.827820 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:04.827824 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:04.827825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:04.827838 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:04.830015 (+ 2177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:04.830579 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:04.830583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:04.830583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:04.830698 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:04.831005 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:04.831006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:04.831006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:04.831333 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:04.832686 (+ 1353us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:04.832773 (+ 87us) server_negotiation.cc:299] Negotiation successful
0929 06:36:04.832910 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1076,"thread_start_us":85,"threads_started":1}
I20260929 06:36:04.834133 22397 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41937
I20260929 06:36:04.834239 22397 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:04.834450 22397 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
W20260929 06:36:04.835404 22397 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:41937 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260929 06:36:04.835477 22397 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:04.835546 22397 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
I20260929 06:36:04.835908 22397 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:04.836011 22397 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
W20260929 06:36:04.836344 22397 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:36:04.941215 22401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:04.941545 22401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:04.941599 22401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:04.943391 22401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:04.943459 22401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:04.943501 22401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:36:04.945758 22401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.61.84:46711/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:44961
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=41191
--tserver_master_addrs=127.9.61.126:41937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:04.946060 22401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:04.946413 22401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:04.952688 22407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:04.952782 22406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:04.952694 22409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:04.953397 22401 server_base.cc:1034] running on GCE node
I20260929 06:36:04.953608 22401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:04.953912 22401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:04.955092 22401 hybrid_clock.cc:648] HybridClock initialized: now 1790663764955071 us; error 36 us; skew 500 ppm
Sep 29 06:36:04 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663764, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:04.958015 22401 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:36:04.958598 22401 webserver.cc:460] Webserver started at http://127.9.61.66:41191/ using document root <none> and password file <none>
I20260929 06:36:04.958841 22401 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:04.958923 22401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 06:36:04 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663764, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:36:04.984156 22401 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260929 06:36:04.986963 22417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:04.987205 22401 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.000s
I20260929 06:36:04.987299 22401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "cc357b69811a46888c088171441335a3"
format_stamp: "Formatted at 2026-09-29 06:36:03 on dist-test-slave-601b"
server_key: "730dc5ce62107361c9b6397432965966"
server_key_iv: "31bdcc5d3de5259066066293a3bb595c"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:04.987775 22401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:05.024611 22401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:05.026926 22401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:05.027081 22401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:05.027356 22401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:05.027738 22401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:05.027793 22401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:05.027848 22401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:05.027877 22401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:05.035135 22401 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:44961
I20260929 06:36:05.035561 22401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:36:05.036191 22530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:44961 every 8 connection(s)
I20260929 06:36:05.039880 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 22401
I20260929 06:36:05.040197 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.61.84:46711/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:41409
--local_ip_for_outbound_sockets=127.9.61.67
--tserver_master_addrs=127.9.61.126:41937
--webserver_port=43899
--webserver_interface=127.9.61.67
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:37543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.61.84:46711/kms with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:36:05 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663764, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:05.045346 22533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:05.036400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41937 (local address 127.9.61.66:51267)
0929 06:36:05.036538 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:05.036580 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:05.037125 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:05.037400 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:05.037404 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:05.037575 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:05.037764 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:05.037768 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:05.038495 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:05.038506 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:05.039297 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:05.039299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:05.039734 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:05.039736 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:05.039866 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:05.040488 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:05.040499 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:05.041767 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:05.043632 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:05.043639 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:05.043641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:05.043983 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:05.044194 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:05.044194 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:05.044195 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:05.044326 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:05.044623 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:05.044629 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:05.044796 (+ 167us) client_negotiation.cc:769] Sending connection context
0929 06:36:05.044921 (+ 125us) client_negotiation.cc:240] Negotiation successful
0929 06:36:05.045085 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":74,"threads_started":1}
I20260929 06:36:05.045965 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:05.036732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:51267 (local address 127.9.61.126:41937)
0929 06:36:05.036771 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:05.036773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:05.036784 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:36:05.037243 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:05.037245 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:05.037261 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:05.037311 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:05.037875 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:05.038386 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:05.039395 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:05.039613 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:05.039702 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:05.041881 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:05.041883 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:05.041884 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:05.041892 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:05.043527 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:05.044069 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:05.044071 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:05.044071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:05.044130 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:05.044394 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:05.044394 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:05.044395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:05.044535 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:05.044596 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:05.045689 (+ 1093us) server_negotiation.cc:299] Negotiation successful
0929 06:36:05.045796 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:36:05.048044 22531 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41937
I20260929 06:36:05.048200 22531 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:05.048448 22531 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
W20260929 06:36:05.049223 22531 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:41937 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260929 06:36:05.049360 22531 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:05.049475 22531 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
I20260929 06:36:05.049850 22531 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:05.049973 22531 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
W20260929 06:36:05.050328 22531 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:36:05.141618 22534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:05.141892 22534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:05.141932 22534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:05.143618 22534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:05.143683 22534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:05.143734 22534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:36:05.145740 22534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:37543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.61.84:46711/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:41409
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=43899
--tserver_master_addrs=127.9.61.126:41937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:05.146005 22534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:05.146261 22534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:05.151767 22543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:05.152108 22540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:05.152664 22541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:05.153147 22534 server_base.cc:1034] running on GCE node
I20260929 06:36:05.153373 22534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:05.153695 22534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:05.154879 22534 hybrid_clock.cc:648] HybridClock initialized: now 1790663765154859 us; error 32 us; skew 500 ppm
Sep 29 06:36:05 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663765, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:05.157935 22534 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:36:05.158452 22534 webserver.cc:460] Webserver started at http://127.9.61.67:43899/ using document root <none> and password file <none>
I20260929 06:36:05.158718 22534 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:05.158810 22534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 29 06:36:05 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663765, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:36:05.180262 22534 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.000s
I20260929 06:36:05.181747 22551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:05.181996 22534 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:36:05.182093 22534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37"
format_stamp: "Formatted at 2026-09-29 06:36:04 on dist-test-slave-601b"
server_key: "1ce2fbbf73f4d63956df88156704f7a6"
server_key_iv: "493e264621fd14a135eb911bfdf9c0b2"
server_key_version: "kuduclusterkey@0"
I20260929 06:36:05.182495 22534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:05.199295 22534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:05.201571 22534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:05.201731 22534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:05.201992 22534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:05.202358 22534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:05.202418 22534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:05.202459 22534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:05.202487 22534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:05.209661 22534 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:41409
I20260929 06:36:05.210057 22534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:36:05.210561 22664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:41409 every 8 connection(s)
I20260929 06:36:05.217746 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 22534
Sep 29 06:36:05 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663765, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:05.226265 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:05.211598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:53681 (local address 127.9.61.126:41937)
0929 06:36:05.211656 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:05.211659 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:05.211891 (+ 232us) server_negotiation.cc:407] Connection header received
0929 06:36:05.212586 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:05.212588 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:05.212602 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:05.212702 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:05.216730 (+ 4028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:05.217482 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:05.219487 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:05.219782 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:05.219867 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:05.222543 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:05.222544 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:05.222544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:05.222551 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:05.224344 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:05.224800 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:05.224802 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:05.224802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:05.224860 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:05.225490 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:05.225492 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:05.225492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:05.225624 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:05.225679 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:05.226089 (+ 410us) server_negotiation.cc:299] Negotiation successful
0929 06:36:05.226175 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:36:05.226538 22668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:05.218170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35132 (local address 127.9.61.126:41937)
0929 06:36:05.219510 (+ 1340us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:05.219512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:05.219709 (+ 197us) server_negotiation.cc:407] Connection header received
0929 06:36:05.219732 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:05.219733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:05.219745 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:05.219803 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:05.220634 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:05.221168 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:05.222322 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:05.222525 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:05.222606 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:05.223925 (+ 1319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:05.223926 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:05.223926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:05.223932 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:05.225378 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:05.225775 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:05.225776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:05.225777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:05.225830 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:05.226029 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:05.226030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:05.226031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:05.226131 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:05.226297 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:05.226330 (+ 33us) server_negotiation.cc:299] Negotiation successful
0929 06:36:05.226405 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1310,"thread_start_us":63,"threads_started":1}
I20260929 06:36:05.227216 22667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:05.211194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41937 (local address 127.9.61.67:53681)
0929 06:36:05.211766 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:05.211811 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:05.212476 (+ 665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:05.216146 (+ 3670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:05.216152 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:05.216398 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:05.216613 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:05.216618 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:05.218014 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:05.218016 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:05.219362 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:05.219365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:05.220002 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:05.220004 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:05.220147 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:05.220786 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:05.220796 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:05.222431 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:05.224434 (+ 2003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:05.224441 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:05.224444 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:05.224733 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:05.225245 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:05.225246 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:05.225246 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:05.225393 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:05.225728 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:05.225734 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:05.225896 (+ 162us) client_negotiation.cc:769] Sending connection context
0929 06:36:05.226794 (+ 898us) client_negotiation.cc:240] Negotiation successful
0929 06:36:05.226979 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":157,"threads_started":1}
I20260929 06:36:05.227715 22665 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41937
I20260929 06:36:05.227834 22665 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:05.228053 22665 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
W20260929 06:36:05.228719 22665 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:41937 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260929 06:36:05.228804 22665 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:05.228868 22665 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
I20260929 06:36:05.229174 22665 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:05.229259 22665 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
W20260929 06:36:05.229542 22665 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 29 06:36:05 dist-test-slave-601b krb5kdc[21203](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790663765, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:05.836536 22397 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:05.836690 22397 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
I20260929 06:36:05.837086 22199 ts_manager.cc:194] Registered new tserver with Master: 598c3f572fc94cb7a9376877d5f46c1a (127.9.61.65:38627)
I20260929 06:36:05.838141 22199 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:46415
I20260929 06:36:06.050568 22531 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:06.050747 22531 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
I20260929 06:36:06.051144 22199 ts_manager.cc:194] Registered new tserver with Master: cc357b69811a46888c088171441335a3 (127.9.61.66:44961)
I20260929 06:36:06.051704 22199 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:51267
Sep 29 06:36:06 dist-test-slave-601b krb5kdc[21203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663765, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for HTTP/127.9.61.84@KRBTEST.COM
I20260929 06:36:06.229768 22665 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:06.229970 22665 heartbeater.cc:511] Master 127.9.61.126:41937 requested a full tablet report, sending...
I20260929 06:36:06.230368 22198 ts_manager.cc:194] Registered new tserver with Master: d8aea0c2b7bf47d397e3c1e2c55f7e37 (127.9.61.67:41409)
I20260929 06:36:06.230810 22198 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:53681
I20260929 06:36:06.231346 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:36:06.239404 22687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.232333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35148 (local address 127.9.61.126:41937)
0929 06:36:06.232604 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:06.232606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:06.232611 (+ 5us) server_negotiation.cc:407] Connection header received
0929 06:36:06.232629 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:06.232630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:06.232638 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:06.232712 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:06.233276 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.233841 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.234566 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.234779 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.234878 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:06.236208 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:06.236210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:06.236210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:06.236217 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:06.237755 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:06.238201 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:06.238202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:06.238203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:06.238269 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:06.238481 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:06.238482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:06.238483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:06.238613 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:06.238706 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:06.239177 (+ 471us) server_negotiation.cc:299] Negotiation successful
0929 06:36:06.239267 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":60,"threads_started":1}
I20260929 06:36:06.242390 22198 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:36:06.244110 22198 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:36:06.256312 22692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.250842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:41409 (local address 127.0.0.1:59638)
0929 06:36:06.251692 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:06.251718 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:06.251822 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:06.252238 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:06.252241 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:06.252244 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:06.252343 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:06.252346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.253631 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.253632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:06.254956 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:06.254959 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.255997 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.255998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:06.256084 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:06.256100 (+ 16us) client_negotiation.cc:769] Sending connection context
0929 06:36:06.256167 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 06:36:06.256219 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"thread_start_us":82,"threads_started":1}
I20260929 06:36:06.256584 22694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.250940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59638 (local address 127.9.61.67:41409)
0929 06:36:06.252083 (+ 1143us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:06.252093 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:06.252102 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:36:06.252131 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:06.252133 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:06.252146 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:06.252233 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:06.252438 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.253543 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.255053 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.255808 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.255872 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:06.255963 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:06.256464 (+ 501us) server_negotiation.cc:299] Negotiation successful
0929 06:36:06.256515 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1105,"thread_start_us":56,"threads_started":1}
I20260929 06:36:06.257354 22697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.251315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42276 (local address 127.9.61.65:38627)
0929 06:36:06.251438 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:06.251444 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:06.252467 (+ 1023us) server_negotiation.cc:407] Connection header received
0929 06:36:06.252509 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:06.252511 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:06.252527 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:06.252594 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:06.252793 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.254159 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.255375 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.256958 (+ 1583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.257024 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:06.257079 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:06.257183 (+ 104us) server_negotiation.cc:299] Negotiation successful
0929 06:36:06.257228 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":68,"threads_started":1}
I20260929 06:36:06.257443 22599 tablet_service.cc:1467] Processing CreateTablet for tablet 7d7552bff3ee405f866a6e76ed439c9e (DEFAULT_TABLE table=test-table [id=e0e495f4113e4a3093f32391bf5bc315]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:06.257637 22695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.251063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:38627 (local address 127.0.0.1:42276)
0929 06:36:06.252344 (+ 1281us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:06.252355 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:06.252401 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:06.252676 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:06.252677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:06.252678 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:06.252719 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:06.252720 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.254251 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.254252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:06.255288 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:06.255291 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.257024 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.257025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:06.257084 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:06.257089 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:36:06.257511 (+ 422us) client_negotiation.cc:240] Negotiation successful
0929 06:36:06.257559 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1265,"thread_start_us":67,"threads_started":1}
I20260929 06:36:06.257854 22599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d7552bff3ee405f866a6e76ed439c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:06.258317 22331 tablet_service.cc:1467] Processing CreateTablet for tablet 7d7552bff3ee405f866a6e76ed439c9e (DEFAULT_TABLE table=test-table [id=e0e495f4113e4a3093f32391bf5bc315]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:06.258630 22331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d7552bff3ee405f866a6e76ed439c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:06.262241 22693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.250837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:44961 (local address 127.0.0.1:50672)
0929 06:36:06.251571 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:06.251895 (+ 324us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:06.251920 (+ 25us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:06.257342 (+ 5422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:06.257343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:06.257346 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:06.257390 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:06.257391 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.259445 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.259446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:06.260969 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:06.260972 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.261962 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.261963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:06.262055 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:06.262060 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:36:06.262094 (+ 34us) client_negotiation.cc:240] Negotiation successful
0929 06:36:06.262133 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":90,"threads_started":1}
I20260929 06:36:06.263218 22696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.251145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50672 (local address 127.9.61.66:44961)
0929 06:36:06.257171 (+ 6026us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:06.257176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:06.257187 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:36:06.257224 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:06.257226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:06.257242 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:06.257623 (+ 381us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:06.257715 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.259328 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.261080 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.261851 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.263013 (+ 1162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:06.263085 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:06.263117 (+ 32us) server_negotiation.cc:299] Negotiation successful
0929 06:36:06.263156 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5984,"thread_start_us":63,"threads_started":1}
I20260929 06:36:06.263702 22698 tablet_bootstrap.cc:492] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37: Bootstrap starting.
I20260929 06:36:06.263931 22465 tablet_service.cc:1467] Processing CreateTablet for tablet 7d7552bff3ee405f866a6e76ed439c9e (DEFAULT_TABLE table=test-table [id=e0e495f4113e4a3093f32391bf5bc315]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:06.264322 22465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d7552bff3ee405f866a6e76ed439c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:06.264473 22698 tablet_bootstrap.cc:654] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:06.264773 22698 log.cc:824] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:06.265120 22699 tablet_bootstrap.cc:492] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a: Bootstrap starting.
I20260929 06:36:06.265717 22699 tablet_bootstrap.cc:654] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:06.266024 22699 log.cc:824] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:06.267488 22698 tablet_bootstrap.cc:492] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37: No bootstrap required, opened a new log
I20260929 06:36:06.267567 22698 ts_tablet_manager.cc:1397] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260929 06:36:06.269282 22698 raft_consensus.cc:348] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc357b69811a46888c088171441335a3" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44961 } } peers { permanent_uuid: "598c3f572fc94cb7a9376877d5f46c1a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 38627 } } peers { permanent_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41409 } }
I20260929 06:36:06.269416 22698 raft_consensus.cc:374] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:06.269438 22698 raft_consensus.cc:729] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8aea0c2b7bf47d397e3c1e2c55f7e37, State: Initialized, Role: FOLLOWER
I20260929 06:36:06.269582 22698 consensus_queue.cc:260] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc357b69811a46888c088171441335a3" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44961 } } peers { permanent_uuid: "598c3f572fc94cb7a9376877d5f46c1a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 38627 } } peers { permanent_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41409 } }
I20260929 06:36:06.269861 22665 heartbeater.cc:503] Master 127.9.61.126:41937 was elected leader, sending a full tablet report...
I20260929 06:36:06.269861 22698 ts_tablet_manager.cc:1428] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:36:06.271366 22699 tablet_bootstrap.cc:492] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a: No bootstrap required, opened a new log
I20260929 06:36:06.271479 22699 ts_tablet_manager.cc:1397] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260929 06:36:06.273931 22699 raft_consensus.cc:348] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc357b69811a46888c088171441335a3" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44961 } } peers { permanent_uuid: "598c3f572fc94cb7a9376877d5f46c1a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 38627 } } peers { permanent_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41409 } }
I20260929 06:36:06.274101 22699 raft_consensus.cc:374] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:06.274284 22699 raft_consensus.cc:729] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598c3f572fc94cb7a9376877d5f46c1a, State: Initialized, Role: FOLLOWER
I20260929 06:36:06.274516 22699 consensus_queue.cc:260] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc357b69811a46888c088171441335a3" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44961 } } peers { permanent_uuid: "598c3f572fc94cb7a9376877d5f46c1a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 38627 } } peers { permanent_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41409 } }
I20260929 06:36:06.274844 22397 heartbeater.cc:503] Master 127.9.61.126:41937 was elected leader, sending a full tablet report...
I20260929 06:36:06.274853 22699 ts_tablet_manager.cc:1428] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260929 06:36:06.276109 22702 tablet_bootstrap.cc:492] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3: Bootstrap starting.
I20260929 06:36:06.276729 22702 tablet_bootstrap.cc:654] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:06.277033 22702 log.cc:824] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:06.277812 22702 tablet_bootstrap.cc:492] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3: No bootstrap required, opened a new log
I20260929 06:36:06.277905 22702 ts_tablet_manager.cc:1397] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:36:06.279577 22702 raft_consensus.cc:348] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc357b69811a46888c088171441335a3" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44961 } } peers { permanent_uuid: "598c3f572fc94cb7a9376877d5f46c1a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 38627 } } peers { permanent_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41409 } }
I20260929 06:36:06.279745 22702 raft_consensus.cc:374] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:06.279807 22702 raft_consensus.cc:729] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc357b69811a46888c088171441335a3, State: Initialized, Role: FOLLOWER
I20260929 06:36:06.280012 22702 consensus_queue.cc:260] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc357b69811a46888c088171441335a3" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44961 } } peers { permanent_uuid: "598c3f572fc94cb7a9376877d5f46c1a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 38627 } } peers { permanent_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41409 } }
I20260929 06:36:06.280309 22702 ts_tablet_manager.cc:1428] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:36:06.280402 22531 heartbeater.cc:503] Master 127.9.61.126:41937 was elected leader, sending a full tablet report...
I20260929 06:36:06.287014 22704 raft_consensus.cc:482] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:36:06.287158 22704 raft_consensus.cc:504] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc357b69811a46888c088171441335a3" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44961 } } peers { permanent_uuid: "598c3f572fc94cb7a9376877d5f46c1a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 38627 } } peers { permanent_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41409 } }
W20260929 06:36:06.287215 22532 tablet.cc:2369] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:36:06.287642 22704 leader_election.cc:288] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc357b69811a46888c088171441335a3 (127.9.61.66:44961), d8aea0c2b7bf47d397e3c1e2c55f7e37 (127.9.61.67:41409)
I20260929 06:36:06.290984 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.287860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:44961 (local address 127.9.61.65:49213)
0929 06:36:06.288051 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:06.288066 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:06.288136 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:06.288344 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:06.288345 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:06.288347 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:06.288442 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:06.288445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.289246 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.289247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:06.290008 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:06.290010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.290695 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.290696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:06.290772 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:06.290776 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:36:06.290843 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 06:36:06.290884 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":139,"threads_started":1}
I20260929 06:36:06.290973 22696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.288080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:49213 (local address 127.9.61.66:44961)
0929 06:36:06.288124 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:06.288127 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:06.288138 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:36:06.288222 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:06.288223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:06.288234 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:06.288262 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:06.288528 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.289167 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.290206 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.290579 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.290665 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:06.290676 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:06.290848 (+ 172us) server_negotiation.cc:299] Negotiation successful
0929 06:36:06.290889 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:36:06.291721 22466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d7552bff3ee405f866a6e76ed439c9e" candidate_uuid: "598c3f572fc94cb7a9376877d5f46c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc357b69811a46888c088171441335a3" is_pre_election: true
I20260929 06:36:06.291918 22466 raft_consensus.cc:2454] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 598c3f572fc94cb7a9376877d5f46c1a in term 0.
I20260929 06:36:06.292237 22284 leader_election.cc:302] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598c3f572fc94cb7a9376877d5f46c1a, cc357b69811a46888c088171441335a3; no voters:
I20260929 06:36:06.292393 22704 raft_consensus.cc:2781] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:36:06.292430 22704 raft_consensus.cc:482] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:36:06.292462 22704 raft_consensus.cc:3037] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:06.293380 22704 raft_consensus.cc:504] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc357b69811a46888c088171441335a3" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44961 } } peers { permanent_uuid: "598c3f572fc94cb7a9376877d5f46c1a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 38627 } } peers { permanent_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41409 } }
I20260929 06:36:06.293507 22704 leader_election.cc:288] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [CANDIDATE]: Term 1 election: Requested vote from peers cc357b69811a46888c088171441335a3 (127.9.61.66:44961), d8aea0c2b7bf47d397e3c1e2c55f7e37 (127.9.61.67:41409)
I20260929 06:36:06.293867 22466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d7552bff3ee405f866a6e76ed439c9e" candidate_uuid: "598c3f572fc94cb7a9376877d5f46c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc357b69811a46888c088171441335a3"
I20260929 06:36:06.293943 22466 raft_consensus.cc:3037] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:06.294852 22694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.288587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:57407 (local address 127.9.61.67:41409)
0929 06:36:06.288628 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:06.288631 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:06.291531 (+ 2900us) server_negotiation.cc:407] Connection header received
0929 06:36:06.291641 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:06.291642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:06.291655 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:06.291684 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:06.291855 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.292576 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.293869 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.294441 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.294492 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:06.294502 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:06.294717 (+ 215us) server_negotiation.cc:299] Negotiation successful
0929 06:36:06.294766 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:36:06.294852 22466 raft_consensus.cc:2454] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598c3f572fc94cb7a9376877d5f46c1a in term 1.
I20260929 06:36:06.295082 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.288387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:41409 (local address 127.9.61.65:57407)
0929 06:36:06.291471 (+ 3084us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:06.291483 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:06.291562 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:06.291745 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:06.291747 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:06.291748 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:06.291778 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:06.291779 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.292770 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.292770 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:06.293775 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:06.293777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.294561 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.294561 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:06.294621 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:06.294624 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:36:06.294960 (+ 336us) client_negotiation.cc:240] Negotiation successful
0929 06:36:06.295011 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3069,"thread_start_us":95,"threads_started":1}
I20260929 06:36:06.295310 22284 leader_election.cc:302] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598c3f572fc94cb7a9376877d5f46c1a, cc357b69811a46888c088171441335a3; no voters:
I20260929 06:36:06.295420 22704 raft_consensus.cc:2781] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:36:06.295446 22619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d7552bff3ee405f866a6e76ed439c9e" candidate_uuid: "598c3f572fc94cb7a9376877d5f46c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37" is_pre_election: true
I20260929 06:36:06.295605 22619 raft_consensus.cc:2454] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 598c3f572fc94cb7a9376877d5f46c1a in term 0.
I20260929 06:36:06.295608 22704 raft_consensus.cc:686] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [term 1 LEADER]: Becoming Leader. State: Replica: 598c3f572fc94cb7a9376877d5f46c1a, State: Running, Role: LEADER
I20260929 06:36:06.295715 22618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d7552bff3ee405f866a6e76ed439c9e" candidate_uuid: "598c3f572fc94cb7a9376877d5f46c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37"
I20260929 06:36:06.295712 22704 consensus_queue.cc:237] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc357b69811a46888c088171441335a3" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44961 } } peers { permanent_uuid: "598c3f572fc94cb7a9376877d5f46c1a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 38627 } } peers { permanent_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41409 } }
I20260929 06:36:06.295768 22618 raft_consensus.cc:3037] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:06.296589 22618 raft_consensus.cc:2454] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598c3f572fc94cb7a9376877d5f46c1a in term 1.
I20260929 06:36:06.296618 22198 catalog_manager.cc:5495] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 598c3f572fc94cb7a9376877d5f46c1a (127.9.61.65). New cstate: current_term: 1 leader_uuid: "598c3f572fc94cb7a9376877d5f46c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc357b69811a46888c088171441335a3" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598c3f572fc94cb7a9376877d5f46c1a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 38627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41409 } health_report { overall_health: UNKNOWN } } }
I20260929 06:36:06.302958 22697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.300414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42280 (local address 127.9.61.65:38627)
0929 06:36:06.300458 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:06.300460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:06.300520 (+ 60us) server_negotiation.cc:407] Connection header received
0929 06:36:06.300598 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:06.300598 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:06.300619 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:06.300713 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:36:06.300875 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.301345 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.302129 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:06.302342 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:06.302419 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:06.302598 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:36:06.302710 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:36:06.302803 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:06.302829 (+ 26us) server_negotiation.cc:299] Negotiation successful
0929 06:36:06.302859 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:36:06.306089 22618 raft_consensus.cc:1261] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37 [term 1 FOLLOWER]: Refusing update from remote peer 598c3f572fc94cb7a9376877d5f46c1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:36:06.306161 22466 raft_consensus.cc:1261] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3 [term 1 FOLLOWER]: Refusing update from remote peer 598c3f572fc94cb7a9376877d5f46c1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:36:06.306516 22709 consensus_queue.cc:1035] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc357b69811a46888c088171441335a3" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:36:06.306634 22704 consensus_queue.cc:1035] T 7d7552bff3ee405f866a6e76ed439c9e P 598c3f572fc94cb7a9376877d5f46c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8aea0c2b7bf47d397e3c1e2c55f7e37" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:36:06.310734 22712 mvcc.cc:205] Tried to move back new op lower bound from 7334558786786992128 to 7334558786748002304. Current Snapshot: MvccSnapshot[applied={T|T < 7334558786786992128}]
I20260929 06:36:06.311280 22713 mvcc.cc:205] Tried to move back new op lower bound from 7334558786786992128 to 7334558786748002304. Current Snapshot: MvccSnapshot[applied={T|T < 7334558786786992128}]
I20260929 06:36:06.313730 22714 mvcc.cc:205] Tried to move back new op lower bound from 7334558786786992128 to 7334558786748002304. Current Snapshot: MvccSnapshot[applied={T|T < 7334558786786992128}]
I20260929 06:36:06.314105 22198 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:36:06.314203 22198 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:36:06.315124 22198 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 11ab81968701443d9da55b2fbc9ef960: Sending DeleteTablet for 3 replicas of tablet 7d7552bff3ee405f866a6e76ed439c9e
I20260929 06:36:06.315629 22465 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d7552bff3ee405f866a6e76ed439c9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:06 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:50672
I20260929 06:36:06.315853 22599 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d7552bff3ee405f866a6e76ed439c9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:06 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:59638
I20260929 06:36:06.316061 22331 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d7552bff3ee405f866a6e76ed439c9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:06 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:42276
I20260929 06:36:06.316455 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 22238
I20260929 06:36:06.317152 22722 tablet_replica.cc:330] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37: stopping tablet replica
I20260929 06:36:06.317247 22722 raft_consensus.cc:2229] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:36:06.317355 22722 raft_consensus.cc:2258] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:36:06.317844 22722 ts_tablet_manager.cc:1905] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:36:06.319384 22722 ts_tablet_manager.cc:1918] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:36:06.319455 22722 log.cc:1196] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/7d7552bff3ee405f866a6e76ed439c9e
I20260929 06:36:06.319700 22722 ts_tablet_manager.cc:1939] T 7d7552bff3ee405f866a6e76ed439c9e P d8aea0c2b7bf47d397e3c1e2c55f7e37: Deleting consensus metadata
I20260929 06:36:06.320128 22186 catalog_manager.cc:4841] TS d8aea0c2b7bf47d397e3c1e2c55f7e37 (127.9.61.67:41409): tablet 7d7552bff3ee405f866a6e76ed439c9e (table test-table [id=e0e495f4113e4a3093f32391bf5bc315]) successfully deleted
I20260929 06:36:06.320192 22721 tablet_replica.cc:330] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3: stopping tablet replica
I20260929 06:36:06.320333 22721 raft_consensus.cc:2229] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:36:06.320462 22721 raft_consensus.cc:2258] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260929 06:36:06.324821 22183 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:38627 (error 108)
I20260929 06:36:06.325115 22721 ts_tablet_manager.cc:1905] T 7d7552bff3ee405f866a6e76ed439c9e P cc357b69811a46888c088171441335a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:36:06.325676 22693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.325547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:38627 (local address 127.0.0.1:42282)
0929 06:36:06.325601 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:06.325638 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:38627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260929 06:36:06.325804 22183 catalog_manager.cc:4584] TS 598c3f572fc94cb7a9376877d5f46c1a (127.9.61.65:38627): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7d7552bff3ee405f866a6e76ed439c9e: Network error: Client connection negotiation failed: client connection to 127.9.61.65:38627: connect: Connection refused (error 111)
I20260929 06:36:06.326002 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 22401
I20260929 06:36:06.332777 22693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:06.332574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:44961 (local address 127.0.0.1:50686)
0929 06:36:06.332695 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:06.332728 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.66:44961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260929 06:36:06.333091 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 22534
I20260929 06:36:06.339790 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 22166
I20260929 06:36:06.346207 9461 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260929 06:36:06.691135 9461 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260929 06:36:06.691241 9461 mini_ranger.cc:66] Stopping Ranger...
I20260929 06:36:07.036298 9461 mini_ranger.cc:68] Stopped Ranger
2026-09-29 06:36:07.036 UTC [21233] LOG: received smart shutdown request
2026-09-29 06:36:07.040 UTC [21233] LOG: background worker "logical replication launcher" (PID 21242) exited with exit code 1
2026-09-29 06:36:07.040 UTC [21237] LOG: shutting down
2026-09-29 06:36:07.204 UTC [21233] LOG: database system is shut down
2026-09-29T06:36:07Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47136 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:36:07 dist-test-slave-601b krb5kdc[22733](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:36:07 dist-test-slave-601b krb5kdc[22733](info): set up 2 sockets
Sep 29 06:36:07 dist-test-slave-601b krb5kdc[22733](info): commencing operation
krb5kdc: starting...
W20260929 06:36:08.372114 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:36:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:36:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:36:08.487538 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:39301
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:39301,127.9.61.125:40737,127.9.61.124:36971
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:08.567629 22746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:08.567868 22746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:08.567903 22746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:08.569041 22746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:36:08.569109 22746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:08.569133 22746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:08.569154 22746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:36:08.569213 22746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:36:08.570698 22746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:39301,127.9.61.125:40737,127.9.61.124:36971
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:39301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:08.570959 22746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:08.571187 22746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:08.575831 22752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:08.575876 22751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:08.575928 22746 server_base.cc:1034] running on GCE node
W20260929 06:36:08.575855 22754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:08.576278 22746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:08.576525 22746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:08.577692 22746 hybrid_clock.cc:648] HybridClock initialized: now 1790663768577669 us; error 38 us; skew 500 ppm
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:08.580283 22746 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:36:08.580657 22746 webserver.cc:460] Webserver started at http://127.9.61.126:41201/ using document root <none> and password file <none>
I20260929 06:36:08.580842 22746 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:08.580880 22746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:08.580966 22746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:36:08.582015 22746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "3c59b79102374f81b869623e2b2b511f"
format_stamp: "Formatted at 2026-09-29 06:36:08 on dist-test-slave-601b"
server_key: "437ffb403fc81f399c535556330469fc"
server_key_iv: "6b110a418d737320f18e64f17a88db99"
server_key_version: "encryptionkey@0"
I20260929 06:36:08.582334 22746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "3c59b79102374f81b869623e2b2b511f"
format_stamp: "Formatted at 2026-09-29 06:36:08 on dist-test-slave-601b"
server_key: "437ffb403fc81f399c535556330469fc"
server_key_iv: "6b110a418d737320f18e64f17a88db99"
server_key_version: "encryptionkey@0"
I20260929 06:36:08.583562 22746 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:36:08.584275 22761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:08.584444 22746 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:08.584549 22746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "3c59b79102374f81b869623e2b2b511f"
format_stamp: "Formatted at 2026-09-29 06:36:08 on dist-test-slave-601b"
server_key: "437ffb403fc81f399c535556330469fc"
server_key_iv: "6b110a418d737320f18e64f17a88db99"
server_key_version: "encryptionkey@0"
I20260929 06:36:08.584623 22746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:08.592934 22746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:08.595260 22746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:08.595422 22746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:08.599466 22746 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:39301
I20260929 06:36:08.599498 22813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:39301 every 8 connection(s)
I20260929 06:36:08.599848 22746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:36:08.600680 22814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:08.602120 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 22746
I20260929 06:36:08.602236 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:36:08.602142 22814 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:36:08.602458 9461 external_mini_cluster.cc:1428] Setting key 6955d16a15e23513b6797f7c192e43d6
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.61.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.125@KRBTEST.COM" created.
I20260929 06:36:08.613072 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.602839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:39301 (local address 127.0.0.1:48704)
0929 06:36:08.603031 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.603075 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:08.603783 (+ 708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:08.604140 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:08.604143 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:08.604392 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:08.604552 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.604555 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.606102 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.606103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.606846 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.606848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.607607 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.607608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.607664 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.608268 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:08.608276 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:08.609632 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:08.611439 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.611445 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.611447 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.611640 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.611876 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.611877 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.611877 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.612092 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.612428 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:08.612433 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:08.612490 (+ 57us) client_negotiation.cc:769] Sending connection context
0929 06:36:08.612630 (+ 140us) client_negotiation.cc:240] Negotiation successful
0929 06:36:08.612898 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":110,"thread_start_us":101,"threads_started":1}
I20260929 06:36:08.613080 22817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.602909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48704 (local address 127.9.61.126:39301)
0929 06:36:08.603052 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.603060 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.603172 (+ 112us) server_negotiation.cc:407] Connection header received
0929 06:36:08.603989 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.603992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.604016 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.604125 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.604646 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.605988 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.606951 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.607515 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.607639 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.609724 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.609730 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.609731 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.609738 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.611346 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.611714 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.611716 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.611717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.611792 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.612161 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.612162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.612162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.612367 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.612426 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.612625 (+ 199us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.612786 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":57,"threads_started":1}
I20260929 06:36:08.613888 22814 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:36:08.614285 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.614143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:40737 (local address 127.0.0.1:51178)
0929 06:36:08.614196 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.614251 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:40737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260929 06:36:08.614421 22765 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.61.125:40737: connect: Connection refused (error 111)
I20260929 06:36:08.614845 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.614762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:40737 (local address 127.0.0.1:51194)
0929 06:36:08.614805 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.614829 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:40737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 06:36:08.614955 22814 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.125:40737: Network error: Client connection negotiation failed: client connection to 127.9.61.125:40737: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.125.keytab.
Entry for principal kudu/127.9.61.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.125.keytab.
I20260929 06:36:08.628883 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.125:40737
--webserver_interface=127.9.61.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.125.keytab
--principal=kudu/127.9.61.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:39301,127.9.61.125:40737,127.9.61.124:36971
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:36:08.664191 22814 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } attempt: 1
I20260929 06:36:08.664695 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.664549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:40737 (local address 127.0.0.1:51196)
0929 06:36:08.664621 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.664664 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:40737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260929 06:36:08.665130 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.665035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:40737 (local address 127.0.0.1:51206)
0929 06:36:08.665083 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.665109 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:40737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 06:36:08.665254 22814 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.125:40737: Network error: Client connection negotiation failed: client connection to 127.9.61.125:40737: connect: Connection refused (error 111)
W20260929 06:36:08.709386 22821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:08.709595 22821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:08.709618 22821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:08.710687 22821 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:36:08.710724 22821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:08.710738 22821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:08.710750 22821 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:36:08.710762 22821 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:36:08.712168 22821 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:39301,127.9.61.125:40737,127.9.61.124:36971
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.125.keytab
--principal=kudu/127.9.61.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.125:40737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.61.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:08.712358 22821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:08.712525 22821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:08.717221 22826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:08.717377 22821 server_base.cc:1034] running on GCE node
W20260929 06:36:08.717221 22827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:08.717279 22829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:08.717720 22821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:08.718039 22821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:08.719201 22821 hybrid_clock.cc:648] HybridClock initialized: now 1790663768719189 us; error 47 us; skew 500 ppm
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:08.721689 22821 init.cc:377] Logged in from keytab as kudu/127.9.61.125@KRBTEST.COM (short username kudu)
I20260929 06:36:08.722154 22821 webserver.cc:460] Webserver started at http://127.9.61.125:37939/ using document root <none> and password file <none>
I20260929 06:36:08.722380 22821 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:08.722455 22821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:08.722607 22821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:36:08.723672 22821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/data/instance:
uuid: "c296e9346889441eb0eb4ff6218947ee"
format_stamp: "Formatted at 2026-09-29 06:36:08 on dist-test-slave-601b"
server_key: "c93d85dc10e14848591bbcf692dabaf2"
server_key_iv: "f8615d4247b36ea5e347e7120321d931"
server_key_version: "encryptionkey@0"
I20260929 06:36:08.724089 22821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/wal/instance:
uuid: "c296e9346889441eb0eb4ff6218947ee"
format_stamp: "Formatted at 2026-09-29 06:36:08 on dist-test-slave-601b"
server_key: "c93d85dc10e14848591bbcf692dabaf2"
server_key_iv: "f8615d4247b36ea5e347e7120321d931"
server_key_version: "encryptionkey@0"
I20260929 06:36:08.725432 22821 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:36:08.726123 22836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:08.726316 22821 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:36:08.726413 22821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/wal
uuid: "c296e9346889441eb0eb4ff6218947ee"
format_stamp: "Formatted at 2026-09-29 06:36:08 on dist-test-slave-601b"
server_key: "c93d85dc10e14848591bbcf692dabaf2"
server_key_iv: "f8615d4247b36ea5e347e7120321d931"
server_key_version: "encryptionkey@0"
I20260929 06:36:08.726497 22821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:08.733415 22814 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } attempt: 2
I20260929 06:36:08.733814 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.733691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:40737 (local address 127.0.0.1:51212)
0929 06:36:08.733749 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.733786 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:40737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260929 06:36:08.734144 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.734052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:40737 (local address 127.0.0.1:51216)
0929 06:36:08.734096 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.734120 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:40737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260929 06:36:08.734225 22814 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.125:40737: Network error: Client connection negotiation failed: client connection to 127.9.61.125:40737: connect: Connection refused (error 111)
I20260929 06:36:08.743119 22821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:08.745139 22821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:08.745302 22821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:08.749387 22821 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.125:40737
I20260929 06:36:08.749425 22888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.125:40737 every 8 connection(s)
I20260929 06:36:08.749815 22821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
I20260929 06:36:08.750653 22889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:08.752319 22889 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:36:08.753535 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 22821
I20260929 06:36:08.753615 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-1/wal/instance
I20260929 06:36:08.753798 9461 external_mini_cluster.cc:1428] Setting key e317aff63acb6262733196dcb8f090d8
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.125@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.61.124@KRBTEST.COM; defaulting to no policy
I20260929 06:36:08.761737 22817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.753057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48706 (local address 127.9.61.126:39301)
0929 06:36:08.753105 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.753107 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.753344 (+ 237us) server_negotiation.cc:407] Connection header received
0929 06:36:08.753923 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.753924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.753939 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.753997 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.754619 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.755108 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.756170 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.756385 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.756473 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.758615 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.758617 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.758617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.758631 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.760243 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.760687 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.760688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.760689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.760750 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.760998 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.760999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.761000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.761119 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.761195 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.761555 (+ 360us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.761643 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:36:08.761912 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.753061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:39301 (local address 127.0.0.1:48706)
0929 06:36:08.753221 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.753256 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:08.753796 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:08.754067 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:08.754071 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:08.754333 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:08.754522 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.754527 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.755205 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.755206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.756071 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.756073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.756481 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.756482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.756612 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.757149 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:08.757157 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:08.758507 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:08.760324 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.760331 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.760333 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.760595 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.760816 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.760817 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.760818 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.760930 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.761188 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:08.761194 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:08.761405 (+ 211us) client_negotiation.cc:769] Sending connection context
0929 06:36:08.761524 (+ 119us) client_negotiation.cc:240] Negotiation successful
0929 06:36:08.761681 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":74,"threads_started":1}
I20260929 06:36:08.762537 22889 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.124@KRBTEST.COM" created.
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.125@KRBTEST.COM for kudu/127.9.61.125@KRBTEST.COM
I20260929 06:36:08.770380 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.762795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:40737 (local address 127.0.0.1:51222)
0929 06:36:08.762825 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.762994 (+ 169us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:08.763039 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:08.763205 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:08.763205 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:08.763453 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:08.763513 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.763515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.764497 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.764498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.764986 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.764988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.765644 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.765645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.765700 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.766115 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:08.766120 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:08.767320 (+ 1200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:08.769363 (+ 2043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.769363 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.769364 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.769517 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.769739 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.769739 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.769739 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.769786 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.770122 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:08.770123 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:08.770155 (+ 32us) client_negotiation.cc:769] Sending connection context
0929 06:36:08.770205 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 06:36:08.770282 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15}
I20260929 06:36:08.770476 22893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.762856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51222 (local address 127.9.61.125:40737)
0929 06:36:08.763036 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.763041 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.763064 (+ 23us) server_negotiation.cc:407] Connection header received
0929 06:36:08.763086 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.763089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.763104 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.763188 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.763590 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.764405 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.765064 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.765564 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.765639 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.767411 (+ 1772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.767419 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.767419 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.767427 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.769273 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.769600 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.769603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.769604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.769668 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.769847 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.769847 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.769848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.770049 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.770145 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.770240 (+ 95us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.770345 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":141,"thread_start_us":102,"threads_started":1}
I20260929 06:36:08.771104 22889 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:36:08.771508 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.771388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:56964)
0929 06:36:08.771437 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.771481 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 06:36:08.771631 22840 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
I20260929 06:36:08.772013 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.771902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:56978)
0929 06:36:08.771966 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.771993 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 06:36:08.772136 22889 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:36971: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.124.keytab.
Entry for principal kudu/127.9.61.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.124.keytab.
I20260929 06:36:08.778872 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.124:36971
--webserver_interface=127.9.61.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.124.keytab
--principal=kudu/127.9.61.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:39301,127.9.61.125:40737,127.9.61.124:36971
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:36:08.821344 22889 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } attempt: 1
I20260929 06:36:08.821828 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.821702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:56990)
0929 06:36:08.821758 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.821799 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 06:36:08.822237 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.822104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:57006)
0929 06:36:08.822166 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.822208 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260929 06:36:08.822365 22889 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:36971: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
I20260929 06:36:08.825352 22814 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } attempt: 3
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for kudu/127.9.61.125@KRBTEST.COM
I20260929 06:36:08.832566 22893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.825689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51226 (local address 127.9.61.125:40737)
0929 06:36:08.825747 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.825749 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.825760 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:36:08.825855 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.825856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.825870 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.825915 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.826240 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.826750 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.827477 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.827698 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.827784 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.829924 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.829925 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.829926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.829932 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.831459 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.831841 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.831842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.831842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.831895 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.832109 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.832109 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.832110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.832214 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.832272 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.832446 (+ 174us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.832508 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:36:08.832610 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.825628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:40737 (local address 127.0.0.1:51226)
0929 06:36:08.825682 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.825695 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:08.825770 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:08.825928 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:08.825929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:08.826087 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:08.826150 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.826151 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.826835 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.826836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.827375 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.827377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.827786 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.827787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.827888 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.828416 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:08.828422 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:08.829822 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:08.831548 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.831549 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.831550 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.831763 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.831976 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.831977 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.831977 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.832045 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.832285 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:08.832286 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:08.832338 (+ 52us) client_negotiation.cc:769] Sending connection context
0929 06:36:08.832410 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 06:36:08.832514 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 06:36:08.832989 22814 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:36:08.833326 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.833216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:57014)
0929 06:36:08.833267 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.833300 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 06:36:08.833642 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.833557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:57022)
0929 06:36:08.833600 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.833625 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 06:36:08.833734 22814 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:36971: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
W20260929 06:36:08.860531 22896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:08.860730 22896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:08.860751 22896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:08.861816 22896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:36:08.861869 22896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:08.861884 22896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:08.861896 22896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:36:08.861907 22896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:36:08.863315 22896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:39301,127.9.61.125:40737,127.9.61.124:36971
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.124.keytab
--principal=kudu/127.9.61.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.124:36971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.61.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:08.863499 22896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:08.863653 22896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:36:08.864872 22814 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } attempt: 1
I20260929 06:36:08.865307 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.865156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:57036)
0929 06:36:08.865222 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.865270 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260929 06:36:08.865700 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.865610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:57040)
0929 06:36:08.865652 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.865678 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260929 06:36:08.865819 22814 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:36971: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
W20260929 06:36:08.868604 22902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:08.868578 22904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:08.868592 22901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:08.869024 22896 server_base.cc:1034] running on GCE node
I20260929 06:36:08.869233 22896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:08.869475 22896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:08.870622 22896 hybrid_clock.cc:648] HybridClock initialized: now 1790663768870611 us; error 26 us; skew 500 ppm
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:08.873162 22896 init.cc:377] Logged in from keytab as kudu/127.9.61.124@KRBTEST.COM (short username kudu)
I20260929 06:36:08.873589 22896 webserver.cc:460] Webserver started at http://127.9.61.124:44905/ using document root <none> and password file <none>
I20260929 06:36:08.873822 22896 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:08.873898 22896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:08.874045 22896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:36:08.875104 22896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/data/instance:
uuid: "9db283e16c1043958e10b6c1afd98d52"
format_stamp: "Formatted at 2026-09-29 06:36:08 on dist-test-slave-601b"
server_key: "468738daa3ff570e94d0d70142af61bc"
server_key_iv: "63c832f03d71a8c7d812a20555273470"
server_key_version: "encryptionkey@0"
I20260929 06:36:08.875461 22896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/wal/instance:
uuid: "9db283e16c1043958e10b6c1afd98d52"
format_stamp: "Formatted at 2026-09-29 06:36:08 on dist-test-slave-601b"
server_key: "468738daa3ff570e94d0d70142af61bc"
server_key_iv: "63c832f03d71a8c7d812a20555273470"
server_key_version: "encryptionkey@0"
I20260929 06:36:08.876817 22896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:36:08.877493 22911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:08.877662 22896 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:36:08.877758 22896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/wal
uuid: "9db283e16c1043958e10b6c1afd98d52"
format_stamp: "Formatted at 2026-09-29 06:36:08 on dist-test-slave-601b"
server_key: "468738daa3ff570e94d0d70142af61bc"
server_key_iv: "63c832f03d71a8c7d812a20555273470"
server_key_version: "encryptionkey@0"
I20260929 06:36:08.877835 22896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:08.890599 22889 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } attempt: 2
I20260929 06:36:08.890987 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.890870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:57054)
0929 06:36:08.890927 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.890963 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 06:36:08.891311 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.891221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:57056)
0929 06:36:08.891265 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.891288 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 06:36:08.891387 22889 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:36971: Network error: Client connection negotiation failed: client connection to 127.9.61.124:36971: connect: Connection refused (error 111)
I20260929 06:36:08.896111 22896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:08.898404 22896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:08.898563 22896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:08.902397 22896 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.124:36971
I20260929 06:36:08.902437 22963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.124:36971 every 8 connection(s)
I20260929 06:36:08.902789 22896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
I20260929 06:36:08.903321 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 22896
I20260929 06:36:08.903420 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790663621200347-9461-0/minicluster-data/master-2/wal/instance
I20260929 06:36:08.903620 9461 external_mini_cluster.cc:1428] Setting key 6cad12f089d57d24befafd2b68854b96
I20260929 06:36:08.903800 22964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:08.905784 22964 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.124@KRBTEST.COM
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.124@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:08.914294 22817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.906419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48722 (local address 127.9.61.126:39301)
0929 06:36:08.906484 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.906486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.906634 (+ 148us) server_negotiation.cc:407] Connection header received
0929 06:36:08.906707 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.906708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.906719 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.906802 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.907220 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.907678 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.908525 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.908733 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.908818 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.911335 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.911336 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.911337 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.911345 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.912993 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.913417 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.913418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.913418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.913487 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.913728 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.913728 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.913729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.913857 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.913923 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.914114 (+ 191us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.914197 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:36:08.914397 22968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.906353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:39301 (local address 127.0.0.1:48722)
0929 06:36:08.906531 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.906568 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:08.906653 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:08.906824 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:08.906827 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:08.907072 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:08.907134 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.907135 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.907763 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.907764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.908419 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.908421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.908828 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.908829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.908908 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.909325 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:08.909332 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:08.911248 (+ 1916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:08.913086 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.913092 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.913093 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.913350 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.913553 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.913554 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.913554 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.913656 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.913930 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:08.913937 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:08.913983 (+ 46us) client_negotiation.cc:769] Sending connection context
0929 06:36:08.914075 (+ 92us) client_negotiation.cc:240] Negotiation successful
0929 06:36:08.914202 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":100,"threads_started":1}
I20260929 06:36:08.914412 22967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.904146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57068 (local address 127.9.61.124:36971)
0929 06:36:08.904313 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.904323 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.904358 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:36:08.904915 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.904922 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.904973 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.905119 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.905812 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.906944 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.907758 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.908261 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.908393 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.910725 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.910732 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.910733 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.910740 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.912726 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.913061 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.913064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.913064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.913162 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.913420 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.913421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.913421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.913711 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.913842 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.913981 (+ 139us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.914116 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
I20260929 06:36:08.914973 22964 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.124@KRBTEST.COM for kudu/127.9.61.125@KRBTEST.COM
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:08.921850 22893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.915275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51228 (local address 127.9.61.125:40737)
0929 06:36:08.915319 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.915321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.915328 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:36:08.915351 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.915352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.915375 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.915417 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.915631 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.916305 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.917044 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.917342 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.917453 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.919137 (+ 1684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.919139 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.919140 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.919147 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.920734 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.921085 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.921086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.921087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.921143 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.921346 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.921347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.921348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.921458 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.921538 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.921688 (+ 150us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.921758 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:36:08.921859 22968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.915215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:40737 (local address 127.0.0.1:51228)
0929 06:36:08.915252 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.915261 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:08.915293 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:08.915426 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:08.915427 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:08.915536 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:08.915578 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.915579 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.916374 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.916375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.916970 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.916972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.917453 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.917454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.917523 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.917980 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:08.917984 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:08.919048 (+ 1064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:08.920827 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.920828 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.920829 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.921001 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.921211 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.921212 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.921213 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.921270 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.921530 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:08.921531 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:08.921573 (+ 42us) client_negotiation.cc:769] Sending connection context
0929 06:36:08.921662 (+ 89us) client_negotiation.cc:240] Negotiation successful
0929 06:36:08.921755 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260929 06:36:08.922327 22817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.915168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48724 (local address 127.9.61.126:39301)
0929 06:36:08.915205 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.915207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.915216 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:36:08.915453 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.915454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.915462 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.915526 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.916076 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.916612 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.917399 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.917700 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.917751 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.919916 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.919918 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.919918 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.919925 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.921210 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.921552 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.921553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.921554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.921623 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.921832 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.921833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.921833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.921970 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.922134 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.922212 (+ 78us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.922269 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:36:08.922673 22964 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.124@KRBTEST.COM for kudu/127.9.61.124@KRBTEST.COM
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.125@KRBTEST.COM
I20260929 06:36:08.928963 22967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.922986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57074 (local address 127.9.61.124:36971)
0929 06:36:08.923022 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.923024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.923116 (+ 92us) server_negotiation.cc:407] Connection header received
0929 06:36:08.923136 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.923137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.923144 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.923184 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.923418 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.923873 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.924532 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.924741 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.924816 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.926511 (+ 1695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.926513 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.926514 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.926521 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.927890 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.928270 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.928271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.928272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.928329 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.928536 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.928536 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.928537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.928628 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.928677 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.928846 (+ 169us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.928908 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:36:08.929173 22968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.922953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:57074)
0929 06:36:08.923041 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.923049 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:08.923095 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:08.923188 (+ 93us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:08.923188 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:08.923314 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:08.923340 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.923341 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.923976 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.923978 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.924442 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.924443 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.924814 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.924815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.924861 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.925272 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:08.925277 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:08.926430 (+ 1153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:08.927986 (+ 1556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.927987 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.927987 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.928202 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.928398 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.928399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.928399 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.928465 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.928699 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:08.928700 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:08.928744 (+ 44us) client_negotiation.cc:769] Sending connection context
0929 06:36:08.928834 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 06:36:08.928965 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":43}
I20260929 06:36:08.930265 22893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.922929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51238 (local address 127.9.61.125:40737)
0929 06:36:08.923003 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.923005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.923014 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:36:08.923035 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.923036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.923046 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.923106 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.923689 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.924207 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.924849 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.925055 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.925129 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.927357 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.927358 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.927359 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.927367 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.929091 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.929416 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.929418 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.929418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.929469 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.929675 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.929676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.929677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.929789 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.929969 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.930009 (+ 40us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.930163 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260929 06:36:08.930939 22964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52: Bootstrap starting.
I20260929 06:36:08.931941 22964 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:08.932015 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:36:08.932257 22964 log.cc:824] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:08.932974 22964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52: No bootstrap required, opened a new log
I20260929 06:36:08.935209 22964 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } }
I20260929 06:36:08.935458 22964 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:08.935557 22964 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9db283e16c1043958e10b6c1afd98d52, State: Initialized, Role: FOLLOWER
I20260929 06:36:08.935771 22964 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } }
I20260929 06:36:08.936173 22964 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:36:08.937834 22977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } } }
I20260929 06:36:08.938113 22977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [sys.catalog]: This master's current role is: FOLLOWER
W20260929 06:36:08.938541 22988 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:36:08.938651 22988 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:36:08.940979 22977 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:36:08.941061 22977 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } }
I20260929 06:36:08.941219 22817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.933437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48732 (local address 127.9.61.126:39301)
0929 06:36:08.933483 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.933485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.933583 (+ 98us) server_negotiation.cc:407] Connection header received
0929 06:36:08.933638 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.933639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.933649 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.933707 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.934363 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.935123 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.936135 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.936435 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.936495 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.938131 (+ 1636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.938132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.938132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.938139 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.939793 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.940220 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.940221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.940222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.940276 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.940464 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.940464 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.940465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.940595 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.940680 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.941053 (+ 373us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.941131 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:36:08.941268 22977 leader_election.cc:288] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c59b79102374f81b869623e2b2b511f (127.9.61.126:39301), c296e9346889441eb0eb4ff6218947ee (127.9.61.125:40737)
I20260929 06:36:08.938544 22896 master_runner.cc:186] Error getting master registration for 127.9.61.126:39301: OK, instance_id { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" instance_seqno: 1790663768598323 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 06:36:08.941498 22896 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 06:36:08.941545 22814 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } attempt: 2
I20260929 06:36:08.944900 22967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.933924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57086 (local address 127.9.61.124:36971)
0929 06:36:08.933961 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.933962 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.934492 (+ 530us) server_negotiation.cc:407] Connection header received
0929 06:36:08.934512 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.934513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.934523 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.934564 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.935209 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.935910 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.936865 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.937169 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.937234 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.940357 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.940358 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.940358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.940364 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.943440 (+ 3076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.943852 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.943853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.943853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.943909 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.944146 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.944146 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.944147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.944289 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.944708 (+ 419us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.944747 (+ 39us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.944816 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:36:08.947026 22893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.933618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51240 (local address 127.9.61.125:40737)
0929 06:36:08.933655 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.933657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.933871 (+ 214us) server_negotiation.cc:407] Connection header received
0929 06:36:08.933969 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.933970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.933980 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.934010 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.934699 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.935349 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.936357 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.936669 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.936718 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.943342 (+ 6624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.943344 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.943344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.943352 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.945203 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.945573 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.945574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.945574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.945635 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.945843 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.945843 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.945844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.945980 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.946077 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.946819 (+ 742us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.946925 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for kudu/127.9.61.124@KRBTEST.COM
I20260929 06:36:08.952404 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.941742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:57096)
0929 06:36:08.941782 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.941791 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:08.941833 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:08.943491 (+ 1658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:08.943492 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:08.943649 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:08.943693 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.943695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.944824 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.944825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.945606 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.945609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.946373 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.946375 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.946438 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.946833 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:08.946839 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:08.948294 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:08.951153 (+ 2859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.951154 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.951154 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.951388 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.951589 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.951590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.951590 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.951660 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.952065 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:08.952066 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:08.952131 (+ 65us) client_negotiation.cc:769] Sending connection context
0929 06:36:08.952207 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 06:36:08.952308 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260929 06:36:08.952730 22990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.941856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57096 (local address 127.9.61.124:36971)
0929 06:36:08.943352 (+ 1496us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.943354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.943361 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:36:08.943379 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.943380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.943391 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.943773 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.943816 (+ 43us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.944711 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.945987 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.946297 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.946360 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.948401 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.948402 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.948402 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.948408 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.951080 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.951471 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.951472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.951473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.951529 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.951734 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.951734 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.951735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.951929 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.952053 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.952539 (+ 486us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.952620 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1472,"thread_start_us":84,"threads_started":1}
I20260929 06:36:08.954313 22814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f: Bootstrap starting.
I20260929 06:36:08.955101 22814 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:08.955399 22814 log.cc:824] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:08.956501 22814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f: No bootstrap required, opened a new log
I20260929 06:36:08.958608 22814 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } }
I20260929 06:36:08.958748 22814 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:08.958787 22814 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c59b79102374f81b869623e2b2b511f, State: Initialized, Role: FOLLOWER
I20260929 06:36:08.958925 22814 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } }
I20260929 06:36:08.959198 22992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } } }
I20260929 06:36:08.959236 22814 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:36:08.959410 22788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9db283e16c1043958e10b6c1afd98d52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c59b79102374f81b869623e2b2b511f" is_pre_election: true
I20260929 06:36:08.959859 22788 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9db283e16c1043958e10b6c1afd98d52 in term 0.
I20260929 06:36:08.959290 22992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:36:08.960125 22913 leader_election.cc:302] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c59b79102374f81b869623e2b2b511f, 9db283e16c1043958e10b6c1afd98d52; no voters:
I20260929 06:36:08.960248 22977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:36:08.960304 22977 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:36:08.960328 22977 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:08.961190 22977 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } }
I20260929 06:36:08.961333 22977 leader_election.cc:288] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [CANDIDATE]: Term 1 election: Requested vote from peers 3c59b79102374f81b869623e2b2b511f (127.9.61.126:39301), c296e9346889441eb0eb4ff6218947ee (127.9.61.125:40737)
I20260929 06:36:08.961491 22788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9db283e16c1043958e10b6c1afd98d52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c59b79102374f81b869623e2b2b511f"
I20260929 06:36:08.961565 22788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:08.962461 22788 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9db283e16c1043958e10b6c1afd98d52 in term 1.
I20260929 06:36:08.962625 22913 leader_election.cc:302] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c59b79102374f81b869623e2b2b511f, 9db283e16c1043958e10b6c1afd98d52; no voters:
I20260929 06:36:08.962719 22977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:36:08.962829 22977 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [term 1 LEADER]: Becoming Leader. State: Replica: 9db283e16c1043958e10b6c1afd98d52, State: Running, Role: LEADER
I20260929 06:36:08.962908 22977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } }
W20260929 06:36:08.963231 23003 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:36:08.963276 23003 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:36:08.963236 22977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9db283e16c1043958e10b6c1afd98d52. Latest consensus state: current_term: 1 leader_uuid: "9db283e16c1043958e10b6c1afd98d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } } }
I20260929 06:36:08.963311 22977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:08.963598 23007 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:36:08.963873 23007 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:36:08.963764 22746 master_runner.cc:186] Error getting master registration for 127.9.61.125:40737: OK, instance_id { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" instance_seqno: 1790663768748247 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 06:36:08.966094 22746 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 06:36:08.967572 22788 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [term 1 FOLLOWER]: Refusing update from remote peer 9db283e16c1043958e10b6c1afd98d52: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:36:08.967891 23004 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 06:36:08.969547 22992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9db283e16c1043958e10b6c1afd98d52. Latest consensus state: current_term: 1 leader_uuid: "9db283e16c1043958e10b6c1afd98d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } } }
I20260929 06:36:08.969642 22992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:36:08.975643 22977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9db283e16c1043958e10b6c1afd98d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } } }
I20260929 06:36:08.975726 22977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:08.976255 23008 mvcc.cc:205] Tried to move back new op lower bound from 7334558797688578048 to 7334558797672624128. Current Snapshot: MvccSnapshot[applied={T|T < 7334558797688578048}]
I20260929 06:36:08.976536 22992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9db283e16c1043958e10b6c1afd98d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } } }
I20260929 06:36:08.976608 22992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:36:08.976930 23009 mvcc.cc:205] Tried to move back new op lower bound from 7334558797688578048 to 7334558797672624128. Current Snapshot: MvccSnapshot[applied={T|T < 7334558797688578048 or (T in {7334558797688578048})}]
I20260929 06:36:08.980528 23007 catalog_manager.cc:1347] Generated new cluster ID: 8281b014a5b64fe68c43989f97546036
I20260929 06:36:08.980659 23007 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:36:08.982518 22889 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } attempt: 3
Sep 29 06:36:08 dist-test-slave-601b krb5kdc[22733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663768, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.125@KRBTEST.COM for kudu/127.9.61.124@KRBTEST.COM
I20260929 06:36:08.991164 22891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.982857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:36971 (local address 127.0.0.1:57112)
0929 06:36:08.982946 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:08.982957 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:08.982994 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:08.983436 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:08.983437 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:08.983634 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:08.983682 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.983684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.984752 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.984753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.985552 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:08.985554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.986067 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.986068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:08.986121 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.986636 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:08.986642 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:08.988203 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:08.990089 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.990090 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.990091 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.990295 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.990484 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:08.990485 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:08.990485 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:08.990550 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:08.990831 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:08.990831 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:08.990872 (+ 41us) client_negotiation.cc:769] Sending connection context
0929 06:36:08.990934 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 06:36:08.991036 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260929 06:36:08.991544 22990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:08.983155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57112 (local address 127.9.61.124:36971)
0929 06:36:08.983188 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:08.983190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:08.983196 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:36:08.983213 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:08.983214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:08.983231 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:08.983276 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:08.983846 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.984658 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.985644 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:08.985957 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:08.986015 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:08.988294 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:08.988296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:08.988296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:08.988303 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:08.989997 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.990367 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.990368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.990368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.990420 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:08.990614 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:08.990614 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:08.990615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:08.990748 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:08.990805 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:08.991359 (+ 554us) server_negotiation.cc:299] Negotiation successful
0929 06:36:08.991446 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260929 06:36:08.993062 22889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee: Bootstrap starting.
I20260929 06:36:08.993814 22889 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:08.994164 22889 log.cc:824] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:08.995050 22889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee: No bootstrap required, opened a new log
I20260929 06:36:08.997109 22889 raft_consensus.cc:348] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } }
I20260929 06:36:08.997249 22889 raft_consensus.cc:374] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:08.997288 22889 raft_consensus.cc:729] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c296e9346889441eb0eb4ff6218947ee, State: Initialized, Role: FOLLOWER
I20260929 06:36:08.997398 22889 consensus_queue.cc:260] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } }
I20260929 06:36:08.997710 22889 sys_catalog.cc:564] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:36:08.997793 22861 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:08.998723 22861 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [term 1 FOLLOWER]: Refusing update from remote peer 9db283e16c1043958e10b6c1afd98d52: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 06:36:08.999162 22842 tablet.cc:2369] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:36:08.998893 22863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9db283e16c1043958e10b6c1afd98d52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c296e9346889441eb0eb4ff6218947ee" is_pre_election: true
I20260929 06:36:08.999680 22863 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9db283e16c1043958e10b6c1afd98d52 in term 1.
I20260929 06:36:08.998984 22862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9db283e16c1043958e10b6c1afd98d52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c296e9346889441eb0eb4ff6218947ee"
I20260929 06:36:09.000350 23004 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:36:09.000855 22862 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9db283e16c1043958e10b6c1afd98d52 in term 1.
I20260929 06:36:09.000984 23014 sys_catalog.cc:455] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } } }
I20260929 06:36:09.001070 23014 sys_catalog.cc:458] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:36:09.002417 23028 sys_catalog.cc:455] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9db283e16c1043958e10b6c1afd98d52. Latest consensus state: current_term: 1 leader_uuid: "9db283e16c1043958e10b6c1afd98d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } } }
I20260929 06:36:09.002514 23028 sys_catalog.cc:458] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:36:09.002554 23028 sys_catalog.cc:455] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9db283e16c1043958e10b6c1afd98d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } } }
I20260929 06:36:09.002600 23028 sys_catalog.cc:458] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee [sys.catalog]: This master's current role is: FOLLOWER
W20260929 06:36:09.003192 23025 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:36:09.003245 23025 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:36:09.010623 23026 mvcc.cc:205] Tried to move back new op lower bound from 7334558797688578048 to 7334558797672624128. Current Snapshot: MvccSnapshot[applied={T|T < 7334558797688578048}]
I20260929 06:36:09.011310 23004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9db283e16c1043958e10b6c1afd98d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c59b79102374f81b869623e2b2b511f" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39301 } } peers { permanent_uuid: "c296e9346889441eb0eb4ff6218947ee" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 40737 } } peers { permanent_uuid: "9db283e16c1043958e10b6c1afd98d52" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 36971 } } }
I20260929 06:36:09.011410 23004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:09.012517 23007 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:36:09.013227 23007 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:36:09.019186 23007 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9db283e16c1043958e10b6c1afd98d52: Generated new TSK 0
I20260929 06:36:09.019424 23007 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:36:09.963711 23003 catalog_manager.cc:1259] Loaded cluster ID: 8281b014a5b64fe68c43989f97546036
I20260929 06:36:09.963812 23003 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f: loading cluster ID for follower catalog manager: success
I20260929 06:36:09.964635 23003 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f: acquiring CA information for follower catalog manager: success
I20260929 06:36:09.964949 23003 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3c59b79102374f81b869623e2b2b511f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:36:10.003648 23025 catalog_manager.cc:1259] Loaded cluster ID: 8281b014a5b64fe68c43989f97546036
I20260929 06:36:10.003746 23025 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee: loading cluster ID for follower catalog manager: success
I20260929 06:36:10.004621 23025 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee: acquiring CA information for follower catalog manager: success
I20260929 06:36:10.004949 23025 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c296e9346889441eb0eb4ff6218947ee: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:36:10.068092 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 22746
I20260929 06:36:10.073257 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 22821
I20260929 06:36:10.077862 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 22896
2026-09-29T06:36:10Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2749 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:36:10 dist-test-slave-601b krb5kdc[23040](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:36:10 dist-test-slave-601b krb5kdc[23040](info): set up 2 sockets
Sep 29 06:36:10 dist-test-slave-601b krb5kdc[23040](info): commencing operation
krb5kdc: starting...
W20260929 06:36:11.192094 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:36:11 dist-test-slave-601b krb5kdc[23040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:36:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:36:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:36:11.306993 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:36165
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:45947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:36165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:11.385432 23053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:11.385677 23053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:11.385712 23053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:11.386825 23053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:36:11.386894 23053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:11.386917 23053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:11.386937 23053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:36:11.386965 23053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:36:11.388495 23053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:45947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:36165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:36165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:11.388768 23053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:11.388990 23053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:11.393615 23059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:11.393625 23058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:11.393625 23061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:11.393899 23053 server_base.cc:1034] running on GCE node
I20260929 06:36:11.394147 23053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:11.394460 23053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:11.395619 23053 hybrid_clock.cc:648] HybridClock initialized: now 1790663771395598 us; error 37 us; skew 500 ppm
Sep 29 06:36:11 dist-test-slave-601b krb5kdc[23040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663771, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:11.398257 23053 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:36:11.398710 23053 webserver.cc:460] Webserver started at http://127.9.61.126:37721/ using document root <none> and password file <none>
I20260929 06:36:11.398957 23053 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:11.399030 23053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:11.399187 23053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:36:11.400455 23053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "9460629b51934394bdfdfcf107252b1c"
format_stamp: "Formatted at 2026-09-29 06:36:11 on dist-test-slave-601b"
server_key: "b130ee270f340b632e75ad2f2626cb7a"
server_key_iv: "9b9915bae64ee0e7c8e66e9503785ac6"
server_key_version: "encryptionkey@0"
I20260929 06:36:11.400847 23053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "9460629b51934394bdfdfcf107252b1c"
format_stamp: "Formatted at 2026-09-29 06:36:11 on dist-test-slave-601b"
server_key: "b130ee270f340b632e75ad2f2626cb7a"
server_key_iv: "9b9915bae64ee0e7c8e66e9503785ac6"
server_key_version: "encryptionkey@0"
I20260929 06:36:11.402290 23053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:36:11.403064 23068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:11.403245 23053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:36:11.403362 23053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "9460629b51934394bdfdfcf107252b1c"
format_stamp: "Formatted at 2026-09-29 06:36:11 on dist-test-slave-601b"
server_key: "b130ee270f340b632e75ad2f2626cb7a"
server_key_iv: "9b9915bae64ee0e7c8e66e9503785ac6"
server_key_version: "encryptionkey@0"
I20260929 06:36:11.403443 23053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:11.417213 23053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:11.419385 23053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:11.419556 23053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:11.424026 23053 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:36165
I20260929 06:36:11.424033 23120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:36165 every 8 connection(s)
I20260929 06:36:11.424441 23053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:36:11.425336 23121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:11.427506 23121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c: Bootstrap starting.
I20260929 06:36:11.428114 23121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:11.428407 23121 log.cc:824] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:11.429091 23121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c: No bootstrap required, opened a new log
I20260929 06:36:11.430615 23121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9460629b51934394bdfdfcf107252b1c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36165 } }
I20260929 06:36:11.430760 23121 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:11.430784 23121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9460629b51934394bdfdfcf107252b1c, State: Initialized, Role: FOLLOWER
I20260929 06:36:11.430961 23121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9460629b51934394bdfdfcf107252b1c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36165 } }
I20260929 06:36:11.431041 23121 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:36:11.431082 23121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:36:11.431171 23121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:11.431628 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 23053
I20260929 06:36:11.431739 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:36:11.431835 23121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9460629b51934394bdfdfcf107252b1c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36165 } }
I20260929 06:36:11.431972 9461 external_mini_cluster.cc:1428] Setting key 9b1ac40d251e2149045f87050c0ce150
I20260929 06:36:11.431972 23121 leader_election.cc:302] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9460629b51934394bdfdfcf107252b1c; no voters:
I20260929 06:36:11.432127 23121 leader_election.cc:288] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:36:11.432183 23124 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:36:11.432341 23124 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [term 1 LEADER]: Becoming Leader. State: Replica: 9460629b51934394bdfdfcf107252b1c, State: Running, Role: LEADER
I20260929 06:36:11.432367 23121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:36:11.432447 23124 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9460629b51934394bdfdfcf107252b1c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36165 } }
I20260929 06:36:11.433151 23125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9460629b51934394bdfdfcf107252b1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9460629b51934394bdfdfcf107252b1c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36165 } } }
I20260929 06:36:11.433235 23125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:11.433404 23126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9460629b51934394bdfdfcf107252b1c. Latest consensus state: current_term: 1 leader_uuid: "9460629b51934394bdfdfcf107252b1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9460629b51934394bdfdfcf107252b1c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 36165 } } }
I20260929 06:36:11.433491 23126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:11.433681 23136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:36:11.434244 23136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:36:11.435920 23136 catalog_manager.cc:1347] Generated new cluster ID: 2a19a2718e3e427cbc27cfb975efc75e
I20260929 06:36:11.435990 23136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:36:11 dist-test-slave-601b krb5kdc[23040](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:11.444487 23128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:11.432668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34666 (local address 127.9.61.126:36165)
0929 06:36:11.433063 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:11.433072 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:11.433105 (+ 33us) server_negotiation.cc:407] Connection header received
0929 06:36:11.433227 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:11.433236 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:11.433309 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:11.434050 (+ 741us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:11.434328 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:11.435574 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:11.436654 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:11.437247 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:11.437351 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:11.440167 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:11.440171 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:11.440171 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:11.440183 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:11.442797 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:11.443186 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:11.443201 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:11.443201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:11.443332 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:11.443538 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:11.443539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:11.443539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:11.443843 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:11.444026 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:11.444132 (+ 106us) server_negotiation.cc:299] Negotiation successful
0929 06:36:11.444276 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":81,"threads_started":1}
I20260929 06:36:11.445605 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:36:11.451082 23136 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:36:11.451851 23136 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:36:11.460055 23136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9460629b51934394bdfdfcf107252b1c: Generated new TSK 0
I20260929 06:36:11.460403 23136 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:36:11.499590 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 23053
2026-09-29T06:36:11Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1420 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:36:11 dist-test-slave-601b krb5kdc[23148](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:36:11 dist-test-slave-601b krb5kdc[23148](info): set up 2 sockets
Sep 29 06:36:11 dist-test-slave-601b krb5kdc[23148](info): commencing operation
krb5kdc: starting...
W20260929 06:36:12.528098 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:36:12 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:36:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:36:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:36:12.642761 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:45597
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:45597
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:12.721585 23161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:12.721786 23161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:12.721808 23161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:12.722947 23161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:36:12.722990 23161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:12.723003 23161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:12.723016 23161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:36:12.723028 23161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:36:12.724607 23161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:45597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:45597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:12.724862 23161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:12.725096 23161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:12.729933 23166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:12.729872 23167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:12.729889 23169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:12.730036 23161 server_base.cc:1034] running on GCE node
I20260929 06:36:12.730355 23161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:12.730638 23161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:12.731781 23161 hybrid_clock.cc:648] HybridClock initialized: now 1790663772731748 us; error 43 us; skew 500 ppm
Sep 29 06:36:12 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663772, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:12.737987 23161 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:36:12.738471 23161 webserver.cc:460] Webserver started at http://127.9.61.126:35195/ using document root <none> and password file <none>
I20260929 06:36:12.738714 23161 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:12.738790 23161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:12.738940 23161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:36:12.740062 23161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "d3056abe8a9044f3bcdac366895bc743"
format_stamp: "Formatted at 2026-09-29 06:36:12 on dist-test-slave-601b"
server_key: "24c1daec4e89bb10e7c64f7c0d894923"
server_key_iv: "878e9aca05de13c66b30b0f25881363b"
server_key_version: "encryptionkey@0"
I20260929 06:36:12.740417 23161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "d3056abe8a9044f3bcdac366895bc743"
format_stamp: "Formatted at 2026-09-29 06:36:12 on dist-test-slave-601b"
server_key: "24c1daec4e89bb10e7c64f7c0d894923"
server_key_iv: "878e9aca05de13c66b30b0f25881363b"
server_key_version: "encryptionkey@0"
I20260929 06:36:12.741735 23161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:12.742488 23176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:12.742672 23161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:36:12.742786 23161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "d3056abe8a9044f3bcdac366895bc743"
format_stamp: "Formatted at 2026-09-29 06:36:12 on dist-test-slave-601b"
server_key: "24c1daec4e89bb10e7c64f7c0d894923"
server_key_iv: "878e9aca05de13c66b30b0f25881363b"
server_key_version: "encryptionkey@0"
I20260929 06:36:12.742862 23161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:12.765206 23161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:12.767122 23161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:12.767297 23161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:12.771449 23161 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:45597
I20260929 06:36:12.771487 23228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:45597 every 8 connection(s)
I20260929 06:36:12.771862 23161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:36:12.772888 23229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:12.775131 23229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Bootstrap starting.
I20260929 06:36:12.775712 23229 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:12.776021 23229 log.cc:824] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:12.776732 23229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: No bootstrap required, opened a new log
I20260929 06:36:12.777379 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 23161
I20260929 06:36:12.777495 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:36:12.777700 9461 external_mini_cluster.cc:1428] Setting key 0eebf0c664a3913acdec655627a36309
I20260929 06:36:12.778883 23229 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } }
I20260929 06:36:12.779057 23229 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:12.779093 23229 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3056abe8a9044f3bcdac366895bc743, State: Initialized, Role: FOLLOWER
I20260929 06:36:12.779217 23229 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } }
I20260929 06:36:12.779290 23229 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:36:12.779323 23229 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:36:12.779373 23229 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:12.780450 23229 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } }
I20260929 06:36:12.780555 23229 leader_election.cc:302] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3056abe8a9044f3bcdac366895bc743; no voters:
I20260929 06:36:12.780695 23229 leader_election.cc:288] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:36:12.780772 23234 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:36:12.780918 23234 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 1 LEADER]: Becoming Leader. State: Replica: d3056abe8a9044f3bcdac366895bc743, State: Running, Role: LEADER
I20260929 06:36:12.780943 23229 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:36:12.781002 23234 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } }
I20260929 06:36:12.781481 23235 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3056abe8a9044f3bcdac366895bc743" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } } }
I20260929 06:36:12.781560 23235 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:12.781468 23236 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3056abe8a9044f3bcdac366895bc743. Latest consensus state: current_term: 1 leader_uuid: "d3056abe8a9044f3bcdac366895bc743" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } } }
I20260929 06:36:12.781819 23236 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:12.782469 23241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:36:12.783083 23241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:36:12.784813 23241 catalog_manager.cc:1347] Generated new cluster ID: f0996c59d4034fbaa4eeabe271b4a270
I20260929 06:36:12.784869 23241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:36:12 dist-test-slave-601b krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:12.789878 23233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:12.778245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46474 (local address 127.9.61.126:45597)
0929 06:36:12.778450 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:12.778460 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:12.778495 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:36:12.778847 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:12.778856 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:12.778920 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:12.779070 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:12.779832 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:12.781249 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:12.782428 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:12.782944 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:12.783063 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:12.785979 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:12.785983 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:12.785984 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:12.785996 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:12.788061 (+ 2065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:12.788440 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:12.788443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:12.788443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:12.788588 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:12.788788 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:12.788789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:12.788789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:12.789104 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:12.789266 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:12.789366 (+ 100us) server_negotiation.cc:299] Negotiation successful
0929 06:36:12.789663 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":98,"threads_started":1}
I20260929 06:36:12.802580 23241 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:36:12.803242 23241 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:36:12.811116 23241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Generated new TSK 0
I20260929 06:36:12.811347 23241 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:36:12.842476 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45597
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:12.923295 23255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:12.923542 23255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:12.923578 23255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:12.924758 23255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:12.924836 23255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:12.924880 23255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:36:12.926321 23255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:12.926591 23255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:12.926828 23255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:12.931707 23260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:12.931710 23261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:12.931949 23263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:12.931915 23255 server_base.cc:1034] running on GCE node
I20260929 06:36:12.932184 23255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:12.932404 23255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:12.933573 23255 hybrid_clock.cc:648] HybridClock initialized: now 1790663772933564 us; error 36 us; skew 500 ppm
Sep 29 06:36:12 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663772, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:12.936079 23255 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:36:12.936514 23255 webserver.cc:460] Webserver started at http://127.9.61.65:39633/ using document root <none> and password file <none>
I20260929 06:36:12.936738 23255 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:12.936803 23255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:12.936944 23255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:36:12.937965 23255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "617313279f7b4e258425293ca64a00fd"
format_stamp: "Formatted at 2026-09-29 06:36:12 on dist-test-slave-601b"
server_key: "f2a48fc138c639c4f78471d4311949a5"
server_key_iv: "85b806edd0b5327ebf390f668fbe6b7d"
server_key_version: "encryptionkey@0"
I20260929 06:36:12.938335 23255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "617313279f7b4e258425293ca64a00fd"
format_stamp: "Formatted at 2026-09-29 06:36:12 on dist-test-slave-601b"
server_key: "f2a48fc138c639c4f78471d4311949a5"
server_key_iv: "85b806edd0b5327ebf390f668fbe6b7d"
server_key_version: "encryptionkey@0"
I20260929 06:36:12.939653 23255 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:36:12.940442 23270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:12.940598 23255 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:12.940696 23255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "617313279f7b4e258425293ca64a00fd"
format_stamp: "Formatted at 2026-09-29 06:36:12 on dist-test-slave-601b"
server_key: "f2a48fc138c639c4f78471d4311949a5"
server_key_iv: "85b806edd0b5327ebf390f668fbe6b7d"
server_key_version: "encryptionkey@0"
I20260929 06:36:12.940784 23255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:12.970304 23255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:12.972304 23255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:12.972472 23255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:12.972708 23255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:12.973011 23255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:12.973062 23255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:12.973104 23255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:12.973130 23255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:12.978802 23255 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:34903
I20260929 06:36:12.978852 23383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:34903 every 8 connection(s)
I20260929 06:36:12.979158 23255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:36:12 dist-test-slave-601b krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663772, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:12.987931 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 23255
I20260929 06:36:12.988118 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:36:12.988353 9461 external_mini_cluster.cc:1428] Setting key d88ea5eb12ec13eeddae5bfe1b33638f
I20260929 06:36:12.988672 23233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:12.979873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:58787 (local address 127.9.61.126:45597)
0929 06:36:12.979970 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:12.979972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:12.980135 (+ 163us) server_negotiation.cc:407] Connection header received
0929 06:36:12.980657 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:12.980658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:12.980670 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:12.980729 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:12.981865 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:12.982436 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:12.983532 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:12.983729 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:12.983780 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:12.985940 (+ 2160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:12.985941 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:12.985942 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:12.985950 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:12.987179 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:12.987565 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:12.987566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:12.987566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:12.987638 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:12.987879 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:12.987881 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:12.987881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:12.988058 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:12.988137 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:12.988492 (+ 355us) server_negotiation.cc:299] Negotiation successful
0929 06:36:12.988586 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 06:36:12.988844 23386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:12.979824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:58787)
0929 06:36:12.980008 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:12.980050 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:12.980573 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:12.980830 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:12.980834 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:12.981516 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:12.981772 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:12.981777 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:12.982547 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:12.982548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:12.983456 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:12.983459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:12.983796 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:12.983797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:12.983891 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:12.984463 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:12.984471 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:12.985854 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:12.987248 (+ 1394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:12.987254 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:12.987255 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:12.987482 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:12.987706 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:12.987707 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:12.987707 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:12.987801 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:12.988156 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:12.988163 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:12.988333 (+ 170us) client_negotiation.cc:769] Sending connection context
0929 06:36:12.988456 (+ 123us) client_negotiation.cc:240] Negotiation successful
0929 06:36:12.988606 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":92,"threads_started":1}
I20260929 06:36:12.989428 23384 heartbeater.cc:347] Connected to a master server at 127.9.61.126:45597
I20260929 06:36:12.989537 23384 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:12.989709 23384 heartbeater.cc:511] Master 127.9.61.126:45597 requested a full tablet report, sending...
I20260929 06:36:12.990239 23193 ts_manager.cc:194] Registered new tserver with Master: 617313279f7b4e258425293ca64a00fd (127.9.61.65:34903)
I20260929 06:36:12.990844 23193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:58787
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:36:13.014508 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45597
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:13.096246 23389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:13.096441 23389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:13.096464 23389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:13.097608 23389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:13.097651 23389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:13.097708 23389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:36:13.099098 23389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:13.099344 23389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:13.099576 23389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:13.104590 23395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:13.104604 23394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:13.104604 23397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:13.104908 23389 server_base.cc:1034] running on GCE node
I20260929 06:36:13.105114 23389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:13.105412 23389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:13.106557 23389 hybrid_clock.cc:648] HybridClock initialized: now 1790663773106550 us; error 29 us; skew 500 ppm
Sep 29 06:36:13 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663773, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:13.109047 23389 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:36:13.109550 23389 webserver.cc:460] Webserver started at http://127.9.61.66:45311/ using document root <none> and password file <none>
I20260929 06:36:13.109776 23389 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:13.109846 23389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:13.110008 23389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:36:13.111060 23389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "f115df1859484fbf8fa73aed298f9395"
format_stamp: "Formatted at 2026-09-29 06:36:13 on dist-test-slave-601b"
server_key: "1d60769398343a9caaaf9d174e64c72e"
server_key_iv: "7e9f0f48e91e07435fea78042f229cd9"
server_key_version: "encryptionkey@0"
I20260929 06:36:13.111434 23389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "f115df1859484fbf8fa73aed298f9395"
format_stamp: "Formatted at 2026-09-29 06:36:13 on dist-test-slave-601b"
server_key: "1d60769398343a9caaaf9d174e64c72e"
server_key_iv: "7e9f0f48e91e07435fea78042f229cd9"
server_key_version: "encryptionkey@0"
I20260929 06:36:13.112854 23389 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:36:13.113633 23404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.113799 23389 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:36:13.113898 23389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "f115df1859484fbf8fa73aed298f9395"
format_stamp: "Formatted at 2026-09-29 06:36:13 on dist-test-slave-601b"
server_key: "1d60769398343a9caaaf9d174e64c72e"
server_key_iv: "7e9f0f48e91e07435fea78042f229cd9"
server_key_version: "encryptionkey@0"
I20260929 06:36:13.113977 23389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:13.134333 23389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:13.136346 23389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:13.136504 23389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:13.136785 23389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:13.137115 23389 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:13.137168 23389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.137239 23389 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:13.137287 23389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.143276 23389 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:43511
I20260929 06:36:13.143353 23517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:43511 every 8 connection(s)
I20260929 06:36:13.143729 23389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:36:13 dist-test-slave-601b krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663773, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:13.150216 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 23389
I20260929 06:36:13.150345 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:36:13.150532 9461 external_mini_cluster.cc:1428] Setting key 374a5cb9b21e10b68085b73d644eed04
I20260929 06:36:13.154013 23233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.144498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:40555 (local address 127.9.61.126:45597)
0929 06:36:13.144543 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.144544 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.144774 (+ 230us) server_negotiation.cc:407] Connection header received
0929 06:36:13.145275 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.145276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.145288 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.145338 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:13.146559 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.147072 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.148125 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.148347 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.148416 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.150745 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:13.150746 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:13.150747 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:13.150757 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:13.152538 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.153028 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.153030 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.153030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.153098 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.153391 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.153391 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.153392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.153499 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:13.153552 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.153880 (+ 328us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.153950 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:36:13.154325 23520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.144495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:40555)
0929 06:36:13.144636 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.144671 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.145149 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.145442 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.145445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.146060 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:13.146252 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.146257 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.147162 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.147163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.148020 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.148023 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.148428 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.148429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.148528 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.149081 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:13.149089 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:13.150639 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:13.152628 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:13.152634 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:13.152636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:13.152941 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:13.153168 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:13.153169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:13.153169 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:13.153320 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:13.153563 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:13.153569 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:13.153732 (+ 163us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.153861 (+ 129us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.154039 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":75,"threads_started":1}
I20260929 06:36:13.154927 23518 heartbeater.cc:347] Connected to a master server at 127.9.61.126:45597
I20260929 06:36:13.155048 23518 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:13.155230 23518 heartbeater.cc:511] Master 127.9.61.126:45597 requested a full tablet report, sending...
I20260929 06:36:13.155659 23193 ts_manager.cc:194] Registered new tserver with Master: f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511)
I20260929 06:36:13.156235 23193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:40555
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:36:13.175285 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45597
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:13.255359 23523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:13.255553 23523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:13.255576 23523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:13.256675 23523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:13.256711 23523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:13.256737 23523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:36:13.258077 23523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:45597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:13.258246 23523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:13.258414 23523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:13.263446 23528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:13.263586 23523 server_base.cc:1034] running on GCE node
W20260929 06:36:13.263425 23529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:13.263520 23531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:13.263893 23523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:13.264209 23523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:13.265373 23523 hybrid_clock.cc:648] HybridClock initialized: now 1790663773265354 us; error 53 us; skew 500 ppm
Sep 29 06:36:13 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663773, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:13.267716 23523 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:36:13.268206 23523 webserver.cc:460] Webserver started at http://127.9.61.67:33069/ using document root <none> and password file <none>
I20260929 06:36:13.268464 23523 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:13.268533 23523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:13.268697 23523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:36:13.269729 23523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "b9117d6fea824929a4f8b2cde0c5cd31"
format_stamp: "Formatted at 2026-09-29 06:36:13 on dist-test-slave-601b"
server_key: "3f5f8bc098295976b46abeb34929873c"
server_key_iv: "3c0533087be1ed6be8cb6a6220307a2a"
server_key_version: "encryptionkey@0"
I20260929 06:36:13.270092 23523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "b9117d6fea824929a4f8b2cde0c5cd31"
format_stamp: "Formatted at 2026-09-29 06:36:13 on dist-test-slave-601b"
server_key: "3f5f8bc098295976b46abeb34929873c"
server_key_iv: "3c0533087be1ed6be8cb6a6220307a2a"
server_key_version: "encryptionkey@0"
I20260929 06:36:13.271456 23523 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:36:13.272290 23538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.272466 23523 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:13.272571 23523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "b9117d6fea824929a4f8b2cde0c5cd31"
format_stamp: "Formatted at 2026-09-29 06:36:13 on dist-test-slave-601b"
server_key: "3f5f8bc098295976b46abeb34929873c"
server_key_iv: "3c0533087be1ed6be8cb6a6220307a2a"
server_key_version: "encryptionkey@0"
I20260929 06:36:13.272642 23523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:13.293293 23523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:13.295217 23523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:13.295400 23523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:13.295607 23523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:13.295874 23523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:13.295904 23523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.295925 23523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:13.295984 23523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.301810 23523 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:33859
I20260929 06:36:13.301935 23651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:33859 every 8 connection(s)
I20260929 06:36:13.302172 23523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:36:13 dist-test-slave-601b krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663773, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:13.310264 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 23523
I20260929 06:36:13.310369 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:36:13.310561 9461 external_mini_cluster.cc:1428] Setting key 1575a1eab203735c9e4094996303ad16
I20260929 06:36:13.311091 23233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.302946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:59147 (local address 127.9.61.126:45597)
0929 06:36:13.303010 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.303012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.303225 (+ 213us) server_negotiation.cc:407] Connection header received
0929 06:36:13.303690 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.303691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.303701 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.303765 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:13.304771 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.305261 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.306260 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.306435 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.306484 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.308473 (+ 1989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:13.308474 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:13.308475 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:13.308481 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:13.309670 (+ 1189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.310025 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.310026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.310026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.310113 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.310350 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.310351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.310352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.310490 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:13.310562 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.310900 (+ 338us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.310990 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:36:13.311395 23654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.302920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:59147)
0929 06:36:13.303070 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.303128 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.303606 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.303820 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.303823 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.304478 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:13.304685 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.304691 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.305345 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.305346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.306166 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.306168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.306505 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.306506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.306609 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.307050 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:13.307059 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:13.308389 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:13.309742 (+ 1353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:13.309748 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:13.309750 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:13.309959 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:13.310184 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:13.310185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:13.310185 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:13.310281 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:13.310560 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:13.310565 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:13.310727 (+ 162us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.310848 (+ 121us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.311039 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
I20260929 06:36:13.311847 23652 heartbeater.cc:347] Connected to a master server at 127.9.61.126:45597
I20260929 06:36:13.311980 23652 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:13.312160 23652 heartbeater.cc:511] Master 127.9.61.126:45597 requested a full tablet report, sending...
I20260929 06:36:13.312562 23193 ts_manager.cc:194] Registered new tserver with Master: b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859)
I20260929 06:36:13.312889 23193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:59147
I20260929 06:36:13.322631 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:36:13.329912 23233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.324102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46484 (local address 127.9.61.126:45597)
0929 06:36:13.324171 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.324173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.324284 (+ 111us) server_negotiation.cc:407] Connection header received
0929 06:36:13.324323 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.324324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.324333 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.324387 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:13.324915 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.325406 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.326103 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.326290 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.326340 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.327436 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:13.327437 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:13.327437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:13.327443 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:13.328793 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.329113 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.329115 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.329115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.329207 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.329390 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.329391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.329391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.329542 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:13.329637 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.329720 (+ 83us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.329787 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:36:13.331560 23193 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46484:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:36:13.333496 23193 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:36:13.339753 23666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.335836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:33859 (local address 127.0.0.1:42802)
0929 06:36:13.336140 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.336152 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.336203 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.336552 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.336553 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.336555 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:13.336625 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.336627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.337614 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.337615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.338550 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.338552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.339444 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.339445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.339531 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.339545 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.339625 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.339672 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":92,"threads_started":1}
I20260929 06:36:13.339779 23665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.335967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42802 (local address 127.9.61.67:33859)
0929 06:36:13.336321 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.336326 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.336335 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:36:13.336375 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.336377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.336393 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.336475 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:13.336706 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.337519 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.338646 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.339354 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.339429 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.339489 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.339647 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.339690 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":81,"threads_started":1}
I20260929 06:36:13.340435 23664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.335827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43511 (local address 127.0.0.1:51026)
0929 06:36:13.336020 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.336066 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.336145 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.336521 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.336524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.336527 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:13.336598 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.336600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.338053 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.338055 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.339121 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.339124 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.340193 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.340194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.340257 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.340262 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.340326 (+ 64us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.340363 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":50,"threads_started":1}
I20260929 06:36:13.340469 23667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.336035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51026 (local address 127.9.61.66:43511)
0929 06:36:13.336247 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.336251 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.336262 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:36:13.336309 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.336311 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.336324 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.336424 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:13.336664 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.337927 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.339251 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.340103 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.340190 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.340250 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.340341 (+ 91us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.340381 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":91,"threads_started":1}
I20260929 06:36:13.340595 23586 tablet_service.cc:1467] Processing CreateTablet for tablet d856539678054051952497b37f6d3a78 (DEFAULT_TABLE table=test-table [id=666d23d9350c415e86ee1c12340fa96f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:13.341017 23586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d856539678054051952497b37f6d3a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:13.341157 23452 tablet_service.cc:1467] Processing CreateTablet for tablet d856539678054051952497b37f6d3a78 (DEFAULT_TABLE table=test-table [id=666d23d9350c415e86ee1c12340fa96f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:13.341275 23663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.336037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:34903 (local address 127.0.0.1:58070)
0929 06:36:13.336711 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.336721 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.336768 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.336989 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.336990 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.336991 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:13.337032 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.337033 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.338323 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.338324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.339435 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.339438 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.341019 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.341020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.341091 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.341096 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.341160 (+ 64us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.341205 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"mutex_wait_us":9,"thread_start_us":63,"threads_started":1}
I20260929 06:36:13.341495 23452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d856539678054051952497b37f6d3a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:13.341518 23668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.336240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58070 (local address 127.9.61.65:34903)
0929 06:36:13.336473 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.336478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.336827 (+ 349us) server_negotiation.cc:407] Connection header received
0929 06:36:13.336874 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.336876 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.336892 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.336973 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:13.337082 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.338214 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.339521 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.340928 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.341001 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.341050 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.341371 (+ 321us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.341429 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":108,"threads_started":1}
I20260929 06:36:13.343972 23669 tablet_bootstrap.cc:492] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31: Bootstrap starting.
I20260929 06:36:13.344659 23669 tablet_bootstrap.cc:654] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:13.344640 23318 tablet_service.cc:1467] Processing CreateTablet for tablet d856539678054051952497b37f6d3a78 (DEFAULT_TABLE table=test-table [id=666d23d9350c415e86ee1c12340fa96f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:13.344980 23318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d856539678054051952497b37f6d3a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:13.345206 23669 log.cc:824] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:13.345532 23670 tablet_bootstrap.cc:492] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395: Bootstrap starting.
I20260929 06:36:13.346027 23669 tablet_bootstrap.cc:492] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31: No bootstrap required, opened a new log
I20260929 06:36:13.346159 23669 ts_tablet_manager.cc:1397] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:36:13.346185 23670 tablet_bootstrap.cc:654] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:13.346709 23670 log.cc:824] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:13.347398 23670 tablet_bootstrap.cc:492] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395: No bootstrap required, opened a new log
I20260929 06:36:13.347465 23670 ts_tablet_manager.cc:1397] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:36:13.348053 23673 tablet_bootstrap.cc:492] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Bootstrap starting.
I20260929 06:36:13.348377 23669 raft_consensus.cc:348] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.348551 23669 raft_consensus.cc:374] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:13.348584 23669 raft_consensus.cc:729] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9117d6fea824929a4f8b2cde0c5cd31, State: Initialized, Role: FOLLOWER
I20260929 06:36:13.348731 23673 tablet_bootstrap.cc:654] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:13.348718 23669 consensus_queue.cc:260] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.348985 23669 ts_tablet_manager.cc:1428] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:36:13.349298 23673 log.cc:824] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:13.349370 23670 raft_consensus.cc:348] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.349488 23670 raft_consensus.cc:374] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:13.349509 23670 raft_consensus.cc:729] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f115df1859484fbf8fa73aed298f9395, State: Initialized, Role: FOLLOWER
I20260929 06:36:13.349640 23670 consensus_queue.cc:260] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.349918 23670 ts_tablet_manager.cc:1428] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:36:13.349956 23518 heartbeater.cc:503] Master 127.9.61.126:45597 was elected leader, sending a full tablet report...
I20260929 06:36:13.350054 23652 heartbeater.cc:503] Master 127.9.61.126:45597 was elected leader, sending a full tablet report...
I20260929 06:36:13.350121 23673 tablet_bootstrap.cc:492] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: No bootstrap required, opened a new log
I20260929 06:36:13.350354 23673 ts_tablet_manager.cc:1397] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:36:13.352154 23673 raft_consensus.cc:348] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.352356 23673 raft_consensus.cc:374] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:13.352381 23673 raft_consensus.cc:729] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617313279f7b4e258425293ca64a00fd, State: Initialized, Role: FOLLOWER
I20260929 06:36:13.352494 23673 consensus_queue.cc:260] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.352725 23673 ts_tablet_manager.cc:1428] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:36:13.352788 23384 heartbeater.cc:503] Master 127.9.61.126:45597 was elected leader, sending a full tablet report...
I20260929 06:36:13.362977 23674 raft_consensus.cc:482] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:36:13.363101 23674 raft_consensus.cc:504] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.363479 23674 leader_election.cc:288] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511), 617313279f7b4e258425293ca64a00fd (127.9.61.65:34903)
I20260929 06:36:13.366418 23668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.363797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:46803 (local address 127.9.61.65:34903)
0929 06:36:13.363881 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.363883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.363930 (+ 47us) server_negotiation.cc:407] Connection header received
0929 06:36:13.364050 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.364051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.364063 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.364113 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:13.364276 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.364714 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.365671 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.366051 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.366134 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.366144 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.366318 (+ 174us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.366355 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260929 06:36:13.366420 23667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.363812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:44965 (local address 127.9.61.66:43511)
0929 06:36:13.363871 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.363873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.363883 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:36:13.363908 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.363909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.363920 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.364009 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:13.364181 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.364704 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.365669 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.366045 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.366147 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.366165 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.366321 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.366354 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 06:36:13.366438 23678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.363724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:34903 (local address 127.9.61.67:46803)
0929 06:36:13.363875 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.363886 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.363969 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.364115 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.364116 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.364117 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:13.364187 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.364189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.364823 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.364825 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.365580 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.365581 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.366136 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.366137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.366212 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.366216 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.366309 (+ 93us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.366348 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":101,"threads_started":1}
I20260929 06:36:13.366565 23654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.363614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43511 (local address 127.9.61.67:44965)
0929 06:36:13.363776 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.363790 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.363843 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.364024 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.364025 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.364027 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:13.364097 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.364099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.364793 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.364794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.365576 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.365578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.366149 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.366150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.366235 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.366238 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.366315 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.366353 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":36}
I20260929 06:36:13.366731 23338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d856539678054051952497b37f6d3a78" candidate_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617313279f7b4e258425293ca64a00fd" is_pre_election: true
I20260929 06:36:13.366887 23338 raft_consensus.cc:2454] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9117d6fea824929a4f8b2cde0c5cd31 in term 0.
I20260929 06:36:13.367125 23539 leader_election.cc:302] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617313279f7b4e258425293ca64a00fd, b9117d6fea824929a4f8b2cde0c5cd31; no voters:
I20260929 06:36:13.367256 23674 raft_consensus.cc:2781] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:36:13.367314 23674 raft_consensus.cc:482] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:36:13.367331 23674 raft_consensus.cc:3037] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:13.367259 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d856539678054051952497b37f6d3a78" candidate_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f115df1859484fbf8fa73aed298f9395" is_pre_election: true
I20260929 06:36:13.367419 23472 raft_consensus.cc:2454] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9117d6fea824929a4f8b2cde0c5cd31 in term 0.
I20260929 06:36:13.368219 23674 raft_consensus.cc:504] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.368355 23674 leader_election.cc:288] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [CANDIDATE]: Term 1 election: Requested vote from peers f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511), 617313279f7b4e258425293ca64a00fd (127.9.61.65:34903)
I20260929 06:36:13.368494 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d856539678054051952497b37f6d3a78" candidate_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f115df1859484fbf8fa73aed298f9395"
I20260929 06:36:13.368543 23338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d856539678054051952497b37f6d3a78" candidate_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "617313279f7b4e258425293ca64a00fd"
I20260929 06:36:13.368587 23472 raft_consensus.cc:3037] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:13.368634 23338 raft_consensus.cc:3037] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:13.369271 23472 raft_consensus.cc:2454] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9117d6fea824929a4f8b2cde0c5cd31 in term 1.
I20260929 06:36:13.369292 23338 raft_consensus.cc:2454] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9117d6fea824929a4f8b2cde0c5cd31 in term 1.
I20260929 06:36:13.369462 23539 leader_election.cc:302] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9117d6fea824929a4f8b2cde0c5cd31, f115df1859484fbf8fa73aed298f9395; no voters:
I20260929 06:36:13.369560 23674 raft_consensus.cc:2781] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:36:13.369707 23674 raft_consensus.cc:686] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 1 LEADER]: Becoming Leader. State: Replica: b9117d6fea824929a4f8b2cde0c5cd31, State: Running, Role: LEADER
I20260929 06:36:13.369822 23674 consensus_queue.cc:237] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.370636 23193 catalog_manager.cc:5495] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67). New cstate: current_term: 1 leader_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260929 06:36:13.378288 23665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.376192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42810 (local address 127.9.61.67:33859)
0929 06:36:13.376300 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.376302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.376308 (+ 6us) server_negotiation.cc:407] Connection header received
0929 06:36:13.376332 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.376333 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.376347 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.376397 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:36:13.376532 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.376970 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.377644 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.377823 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.377870 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.377985 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:36:13.378071 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:36:13.378124 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.378154 (+ 30us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.378169 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260929 06:36:13.380036 23338 raft_consensus.cc:1261] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Refusing update from remote peer b9117d6fea824929a4f8b2cde0c5cd31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:36:13.380059 23472 raft_consensus.cc:1261] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395 [term 1 FOLLOWER]: Refusing update from remote peer b9117d6fea824929a4f8b2cde0c5cd31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:36:13.380350 23674 consensus_queue.cc:1035] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:36:13.380489 23679 consensus_queue.cc:1035] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:36:13.383239 23683 mvcc.cc:205] Tried to move back new op lower bound from 7334558815761772544 to 7334558815723520000. Current Snapshot: MvccSnapshot[applied={T|T < 7334558815761772544}]
I20260929 06:36:13.383632 23684 mvcc.cc:205] Tried to move back new op lower bound from 7334558815761772544 to 7334558815723520000. Current Snapshot: MvccSnapshot[applied={T|T < 7334558815761772544}]
I20260929 06:36:13.385939 23193 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:36:13.386057 23193 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:36:13.386788 23193 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Sending DeleteTablet for 3 replicas of tablet d856539678054051952497b37f6d3a78
I20260929 06:36:13.387095 23586 tablet_service.cc:1514] Processing DeleteTablet for tablet d856539678054051952497b37f6d3a78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:13 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:42802
I20260929 06:36:13.387126 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 23255
I20260929 06:36:13.387144 23452 tablet_service.cc:1514] Processing DeleteTablet for tablet d856539678054051952497b37f6d3a78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:13 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:51026
I20260929 06:36:13.387787 23693 tablet_replica.cc:330] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395: stopping tablet replica
I20260929 06:36:13.387887 23693 raft_consensus.cc:2229] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:36:13.388008 23693 raft_consensus.cc:2258] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:36:13.388468 23693 ts_tablet_manager.cc:1905] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:36:13.388929 23692 tablet_replica.cc:330] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31: stopping tablet replica
I20260929 06:36:13.389062 23692 raft_consensus.cc:2229] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:36:13.389230 23692 raft_consensus.cc:2258] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:36:13.389926 23692 ts_tablet_manager.cc:1905] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:36:13.390133 23693 ts_tablet_manager.cc:1918] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:36:13.390211 23693 log.cc:1196] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/d856539678054051952497b37f6d3a78
I20260929 06:36:13.390498 23693 ts_tablet_manager.cc:1939] T d856539678054051952497b37f6d3a78 P f115df1859484fbf8fa73aed298f9395: Deleting consensus metadata
I20260929 06:36:13.390915 23177 catalog_manager.cc:4841] TS f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511): tablet d856539678054051952497b37f6d3a78 (table test-table [id=666d23d9350c415e86ee1c12340fa96f]) successfully deleted
I20260929 06:36:13.392297 23692 ts_tablet_manager.cc:1918] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:36:13.392426 23692 log.cc:1196] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/d856539678054051952497b37f6d3a78
I20260929 06:36:13.392773 23692 ts_tablet_manager.cc:1939] T d856539678054051952497b37f6d3a78 P b9117d6fea824929a4f8b2cde0c5cd31: Deleting consensus metadata
I20260929 06:36:13.393239 23179 catalog_manager.cc:4841] TS b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859): tablet d856539678054051952497b37f6d3a78 (table test-table [id=666d23d9350c415e86ee1c12340fa96f]) successfully deleted
W20260929 06:36:13.393903 23177 connection.cc:535] client connection to 127.9.61.65:34903 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260929 06:36:13.393998 23177 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 06:36:13.394145 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 23389
I20260929 06:36:13.394424 23663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.394317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:34903 (local address 127.0.0.1:58086)
0929 06:36:13.394362 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.394389 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260929 06:36:13.394627 23177 catalog_manager.cc:4584] TS 617313279f7b4e258425293ca64a00fd (127.9.61.65:34903): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d856539678054051952497b37f6d3a78: Network error: Client connection negotiation failed: client connection to 127.9.61.65:34903: connect: Connection refused (error 111)
I20260929 06:36:13.399138 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 23523
I20260929 06:36:13.403419 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 23161
I20260929 06:36:13.408617 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:45597
--webserver_interface=127.9.61.126
--webserver_port=35195
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:45597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:13.487990 23695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:13.488178 23695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:13.488199 23695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:13.489353 23695 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:36:13.489395 23695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:13.489409 23695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:13.489423 23695 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:36:13.489480 23695 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:36:13.490916 23695 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:45597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:45597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=35195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:13.491168 23695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:13.491405 23695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:13.499748 23702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:13.499773 23701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:13.499753 23704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:13.501041 23695 server_base.cc:1034] running on GCE node
I20260929 06:36:13.501307 23695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:13.501607 23695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:13.502748 23695 hybrid_clock.cc:648] HybridClock initialized: now 1790663773502723 us; error 43 us; skew 500 ppm
Sep 29 06:36:13 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663773, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:13.505299 23695 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:36:13.505774 23695 webserver.cc:460] Webserver started at http://127.9.61.126:35195/ using document root <none> and password file <none>
I20260929 06:36:13.506023 23695 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:13.506105 23695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:13.507488 23695 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:13.508224 23711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.508397 23695 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:13.508508 23695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "d3056abe8a9044f3bcdac366895bc743"
format_stamp: "Formatted at 2026-09-29 06:36:12 on dist-test-slave-601b"
server_key: "24c1daec4e89bb10e7c64f7c0d894923"
server_key_iv: "878e9aca05de13c66b30b0f25881363b"
server_key_version: "encryptionkey@0"
I20260929 06:36:13.508899 23695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:13.521054 23695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:13.523475 23695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:13.523634 23695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:13.527729 23695 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:45597
I20260929 06:36:13.527761 23763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:45597 every 8 connection(s)
I20260929 06:36:13.528194 23695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:36:13.529697 23764 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:36:13.530280 23764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Bootstrap starting.
I20260929 06:36:13.533455 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 23695
I20260929 06:36:13.533737 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:34903
--local_ip_for_outbound_sockets=127.9.61.65
--tserver_master_addrs=127.9.61.126:45597
--webserver_port=39633
--webserver_interface=127.9.61.65
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:36:13.538448 23764 log.cc:824] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:13.540409 23764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:36:13.540706 23764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Bootstrap complete.
I20260929 06:36:13.542951 23764 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } }
I20260929 06:36:13.543211 23764 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3056abe8a9044f3bcdac366895bc743, State: Initialized, Role: FOLLOWER
I20260929 06:36:13.543395 23764 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } }
I20260929 06:36:13.543471 23764 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:36:13.543526 23764 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:36:13.543577 23764 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 1 FOLLOWER]: Advancing to term 2
I20260929 06:36:13.544626 23764 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } }
I20260929 06:36:13.544750 23764 leader_election.cc:302] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3056abe8a9044f3bcdac366895bc743; no voters:
I20260929 06:36:13.544942 23764 leader_election.cc:288] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 06:36:13.544976 23768 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 06:36:13.545083 23768 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 2 LEADER]: Becoming Leader. State: Replica: d3056abe8a9044f3bcdac366895bc743, State: Running, Role: LEADER
I20260929 06:36:13.545181 23768 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } }
I20260929 06:36:13.545217 23764 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:36:13.545459 23769 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d3056abe8a9044f3bcdac366895bc743" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } } }
I20260929 06:36:13.545677 23769 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:13.545619 23770 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3056abe8a9044f3bcdac366895bc743. Latest consensus state: current_term: 2 leader_uuid: "d3056abe8a9044f3bcdac366895bc743" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } } }
I20260929 06:36:13.545912 23770 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:13.546025 23777 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:36:13.546801 23777 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:36:13.546896 23777 catalog_manager.cc:1259] Loaded cluster ID: f0996c59d4034fbaa4eeabe271b4a270
I20260929 06:36:13.546926 23777 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:36:13.547279 23777 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260929 06:36:13.551903 23777 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260929 06:36:13.554361 23777 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:36:13.554585 23777 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Loaded TSK: 0
I20260929 06:36:13.554803 23777 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 06:36:13.617295 23766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:13.617524 23766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:13.617565 23766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:13.618861 23766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:13.618928 23766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:13.618973 23766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:36:13.620476 23766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:34903
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=39633
--tserver_master_addrs=127.9.61.126:45597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:13.620724 23766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:13.620954 23766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:13.626816 23792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:13.626889 23794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:13.626832 23791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:13.627352 23766 server_base.cc:1034] running on GCE node
I20260929 06:36:13.627569 23766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:13.627831 23766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:13.628980 23766 hybrid_clock.cc:648] HybridClock initialized: now 1790663773628959 us; error 39 us; skew 500 ppm
Sep 29 06:36:13 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663773, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:13.631642 23766 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:36:13.632193 23766 webserver.cc:460] Webserver started at http://127.9.61.65:39633/ using document root <none> and password file <none>
I20260929 06:36:13.632472 23766 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:13.632556 23766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:13.634256 23766 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:36:13.634972 23801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.635193 23766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:13.635285 23766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "617313279f7b4e258425293ca64a00fd"
format_stamp: "Formatted at 2026-09-29 06:36:12 on dist-test-slave-601b"
server_key: "f2a48fc138c639c4f78471d4311949a5"
server_key_iv: "85b806edd0b5327ebf390f668fbe6b7d"
server_key_version: "encryptionkey@0"
I20260929 06:36:13.635689 23766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:13.647855 23766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:13.650285 23766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:13.650437 23766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:13.650681 23766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:13.651140 23808 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 06:36:13.652621 23766 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 06:36:13.652681 23766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 06:36:13.652716 23766 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 06:36:13.653559 23766 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 06:36:13.653605 23766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 06:36:13.653669 23808 tablet_bootstrap.cc:492] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Bootstrap starting.
I20260929 06:36:13.660647 23766 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:34903
I20260929 06:36:13.661059 23766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:36:13.664104 23808 log.cc:824] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:13.664557 23915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:34903 every 8 connection(s)
I20260929 06:36:13.666833 23808 tablet_bootstrap.cc:492] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:36:13.667141 23808 tablet_bootstrap.cc:492] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Bootstrap complete.
I20260929 06:36:13.668406 23808 ts_tablet_manager.cc:1397] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.009s
I20260929 06:36:13.668623 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 23766
I20260929 06:36:13.668897 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:43511
--local_ip_for_outbound_sockets=127.9.61.66
--tserver_master_addrs=127.9.61.126:45597
--webserver_port=45311
--webserver_interface=127.9.61.66
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:36:13.669674 23808 raft_consensus.cc:348] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.669960 23808 raft_consensus.cc:729] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617313279f7b4e258425293ca64a00fd, State: Initialized, Role: FOLLOWER
I20260929 06:36:13.670076 23808 consensus_queue.cc:260] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.670325 23808 ts_tablet_manager.cc:1428] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
Sep 29 06:36:13 dist-test-slave-601b krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663773, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:13.675709 23919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.662043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:36955 (local address 127.9.61.126:45597)
0929 06:36:13.662261 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.662272 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.662579 (+ 307us) server_negotiation.cc:407] Connection header received
0929 06:36:13.663442 (+ 863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.663450 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.663507 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.663651 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:13.664613 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.665622 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.666634 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.667099 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.667241 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.671527 (+ 4286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:13.671531 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:13.671532 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:13.671544 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:13.673653 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.674197 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.674200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.674201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.674316 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.674624 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.674625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.674625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.674904 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:13.674985 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.675365 (+ 380us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.675494 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":83,"threads_started":1}
I20260929 06:36:13.675732 23918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.661948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:36955)
0929 06:36:13.662375 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.662423 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.663205 (+ 782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.663713 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.663717 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.664151 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:13.664465 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.664473 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.665738 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.665739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.666532 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.666534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.667340 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.667341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.667437 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.668068 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:13.668076 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:13.671420 (+ 3344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:13.673745 (+ 2325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:13.673752 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:13.673754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:13.674098 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:13.674396 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:13.674397 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:13.674397 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:13.674546 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:13.674986 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:13.674992 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:13.675176 (+ 184us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.675301 (+ 125us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.675482 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":98,"threads_started":1}
I20260929 06:36:13.676640 23916 heartbeater.cc:347] Connected to a master server at 127.9.61.126:45597
I20260929 06:36:13.676754 23916 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:13.676966 23916 heartbeater.cc:511] Master 127.9.61.126:45597 requested a full tablet report, sending...
I20260929 06:36:13.677754 23728 ts_manager.cc:194] Registered new tserver with Master: 617313279f7b4e258425293ca64a00fd (127.9.61.65:34903)
I20260929 06:36:13.679037 23728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:36955
I20260929 06:36:13.680096 23916 heartbeater.cc:503] Master 127.9.61.126:45597 was elected leader, sending a full tablet report...
I20260929 06:36:13.684381 23923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.678427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:34903 (local address 127.0.0.1:58098)
0929 06:36:13.679662 (+ 1235us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.679702 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.679800 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.680119 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.680122 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.680124 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:13.680536 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.680539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.681847 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.681848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.683141 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.683144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.684105 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.684106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.684185 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.684197 (+ 12us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.684257 (+ 60us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.684305 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1204,"thread_start_us":84,"threads_started":1}
I20260929 06:36:13.684628 23924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.679333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58098 (local address 127.9.61.65:34903)
0929 06:36:13.679588 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.679593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.679891 (+ 298us) server_negotiation.cc:407] Connection header received
0929 06:36:13.679930 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.679933 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.679973 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.680046 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:13.680634 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.681744 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.683238 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.683957 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.684020 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.684071 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.684528 (+ 457us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.684568 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":72,"threads_started":1}
I20260929 06:36:13.685180 23850 tablet_service.cc:1514] Processing DeleteTablet for tablet d856539678054051952497b37f6d3a78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:13 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:58098
I20260929 06:36:13.685708 23925 tablet_replica.cc:330] stopping tablet replica
I20260929 06:36:13.685855 23925 raft_consensus.cc:2229] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:36:13.685983 23925 raft_consensus.cc:2258] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:36:13.686357 23925 ts_tablet_manager.cc:1905] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:36:13.688694 23925 ts_tablet_manager.cc:1918] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:36:13.688776 23925 log.cc:1196] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal/wals/d856539678054051952497b37f6d3a78
I20260929 06:36:13.688997 23925 ts_tablet_manager.cc:1939] T d856539678054051952497b37f6d3a78 P 617313279f7b4e258425293ca64a00fd: Deleting consensus metadata
I20260929 06:36:13.689643 23712 catalog_manager.cc:4841] TS 617313279f7b4e258425293ca64a00fd (127.9.61.65:34903): tablet d856539678054051952497b37f6d3a78 (table test-table [id=666d23d9350c415e86ee1c12340fa96f]) successfully deleted
W20260929 06:36:13.755247 23921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:13.755460 23921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:13.755482 23921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:13.756670 23921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:13.756711 23921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:13.756738 23921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:36:13.758196 23921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:43511
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=45311
--tserver_master_addrs=127.9.61.126:45597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:13.758458 23921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:13.758692 23921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:13.763548 23931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:13.763557 23933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:13.763576 23930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:13.764017 23921 server_base.cc:1034] running on GCE node
I20260929 06:36:13.764219 23921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:13.764462 23921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:13.765623 23921 hybrid_clock.cc:648] HybridClock initialized: now 1790663773765607 us; error 26 us; skew 500 ppm
Sep 29 06:36:13 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663773, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:13.767918 23921 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:36:13.768388 23921 webserver.cc:460] Webserver started at http://127.9.61.66:45311/ using document root <none> and password file <none>
I20260929 06:36:13.768625 23921 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:13.768716 23921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:13.770052 23921 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 06:36:13.770638 23940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.770795 23921 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.770895 23921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "f115df1859484fbf8fa73aed298f9395"
format_stamp: "Formatted at 2026-09-29 06:36:13 on dist-test-slave-601b"
server_key: "1d60769398343a9caaaf9d174e64c72e"
server_key_iv: "7e9f0f48e91e07435fea78042f229cd9"
server_key_version: "encryptionkey@0"
I20260929 06:36:13.771250 23921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:13.795264 23921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:13.797298 23921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:13.797464 23921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:13.797700 23921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:13.798012 23921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:13.798064 23921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.798106 23921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:13.798134 23921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.804095 23921 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:43511
I20260929 06:36:13.804263 24053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:43511 every 8 connection(s)
I20260929 06:36:13.804554 23921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:36:13 dist-test-slave-601b krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663773, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:13.814729 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 23921
I20260929 06:36:13.815042 23919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.805337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:51279 (local address 127.9.61.126:45597)
0929 06:36:13.805386 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.805388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.805661 (+ 273us) server_negotiation.cc:407] Connection header received
0929 06:36:13.806255 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.806256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.806274 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.806327 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:13.807392 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.808022 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.809178 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.809417 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.809510 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.811861 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:13.811863 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:13.811864 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:13.811874 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:13.813450 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.813913 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.813914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.813915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.813981 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.814265 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.814266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.814266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.814394 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:13.814481 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.814877 (+ 396us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.814974 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:36:13.815083 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:33859
--local_ip_for_outbound_sockets=127.9.61.67
--tserver_master_addrs=127.9.61.126:45597
--webserver_port=33069
--webserver_interface=127.9.61.67
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:36:13.815305 24056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.805325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:51279)
0929 06:36:13.805512 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.805552 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.806107 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.806427 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.806430 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.807059 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:13.807278 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.807283 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.808126 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.808127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.809048 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.809051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.809523 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.809524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.809671 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.810269 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:13.810278 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:13.811750 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:13.813555 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:13.813562 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:13.813565 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:13.813815 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:13.814053 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:13.814054 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:13.814054 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:13.814180 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:13.814471 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:13.814478 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:13.814665 (+ 187us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.814799 (+ 134us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.815003 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":83,"threads_started":1}
I20260929 06:36:13.815846 24054 heartbeater.cc:347] Connected to a master server at 127.9.61.126:45597
I20260929 06:36:13.815997 24054 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:13.816198 24054 heartbeater.cc:511] Master 127.9.61.126:45597 requested a full tablet report, sending...
I20260929 06:36:13.816643 23728 ts_manager.cc:194] Registered new tserver with Master: f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511)
I20260929 06:36:13.817024 23728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:51279
W20260929 06:36:13.895874 24057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:13.896137 24057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:13.896176 24057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:13.897316 24057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:13.897380 24057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:13.897421 24057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:36:13.898851 24057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:33859
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=33069
--tserver_master_addrs=127.9.61.126:45597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:13.899114 24057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:13.899338 24057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:13.904196 24065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:13.904304 24062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:13.904251 24063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:13.904448 24057 server_base.cc:1034] running on GCE node
I20260929 06:36:13.904654 24057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:13.904896 24057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:13.906060 24057 hybrid_clock.cc:648] HybridClock initialized: now 1790663773906048 us; error 32 us; skew 500 ppm
Sep 29 06:36:13 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663773, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:13.908586 24057 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:36:13.908965 24057 webserver.cc:460] Webserver started at http://127.9.61.67:33069/ using document root <none> and password file <none>
I20260929 06:36:13.909153 24057 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:13.909205 24057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:13.910491 24057 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:13.911021 24072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.911216 24057 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:36:13.911320 24057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "b9117d6fea824929a4f8b2cde0c5cd31"
format_stamp: "Formatted at 2026-09-29 06:36:13 on dist-test-slave-601b"
server_key: "3f5f8bc098295976b46abeb34929873c"
server_key_iv: "3c0533087be1ed6be8cb6a6220307a2a"
server_key_version: "encryptionkey@0"
I20260929 06:36:13.911659 24057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:13.921976 24057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:13.923933 24057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:13.924160 24057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:13.924396 24057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:13.924697 24057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:13.924754 24057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.924795 24057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:13.924821 24057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.930564 24057 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:33859
I20260929 06:36:13.930610 24185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:33859 every 8 connection(s)
I20260929 06:36:13.930935 24057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:36:13 dist-test-slave-601b krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663773, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:13.940158 23919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.931606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:59799 (local address 127.9.61.126:45597)
0929 06:36:13.931683 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.931685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.931888 (+ 203us) server_negotiation.cc:407] Connection header received
0929 06:36:13.932476 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.932478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.932490 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.932553 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:13.933512 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.934013 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.935003 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.935219 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.935308 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.937483 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:13.937484 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:13.937485 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:13.937493 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:13.938693 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.939100 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.939101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.939102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.939189 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.939436 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.939437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.939437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.939554 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:13.939634 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.939968 (+ 334us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.940050 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260929 06:36:13.940388 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.931585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:59799)
0929 06:36:13.931765 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.931807 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.932364 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.932621 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.932625 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.933214 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:13.933401 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.933406 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.934111 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.934112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.934906 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.934908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.935319 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.935320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.935441 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.935887 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:13.935895 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:13.937381 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:13.938780 (+ 1399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:13.938786 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:13.938789 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:13.939007 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:13.939259 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:13.939260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:13.939260 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:13.939365 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:13.939624 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:13.939630 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:13.939803 (+ 173us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.939925 (+ 122us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.940129 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260929 06:36:13.940644 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 24057
I20260929 06:36:13.940927 24186 heartbeater.cc:347] Connected to a master server at 127.9.61.126:45597
I20260929 06:36:13.941025 24186 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:13.941216 24186 heartbeater.cc:511] Master 127.9.61.126:45597 requested a full tablet report, sending...
I20260929 06:36:13.941639 23728 ts_manager.cc:194] Registered new tserver with Master: b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859)
I20260929 06:36:13.942010 23728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:59799
I20260929 06:36:13.947019 23919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.941031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46496 (local address 127.9.61.126:45597)
0929 06:36:13.941070 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.941073 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.941224 (+ 151us) server_negotiation.cc:407] Connection header received
0929 06:36:13.941306 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.941306 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.941318 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.941369 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:13.942056 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.942547 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.943319 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.943518 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.943593 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.944822 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:13.944823 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:13.944824 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:13.944831 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:13.946057 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.946431 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.946431 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.946432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.946480 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:13.946638 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:13.946638 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:13.946638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:13.946726 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:13.946840 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.946877 (+ 37us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.946934 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:36:13.947804 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:36:13.950327 23919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.948171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46506 (local address 127.9.61.126:45597)
0929 06:36:13.948206 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.948208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.948305 (+ 97us) server_negotiation.cc:407] Connection header received
0929 06:36:13.948351 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.948351 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.948378 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.948429 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:36:13.948529 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.948964 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.949676 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.949847 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.949896 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.950063 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:36:13.950151 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:36:13.950208 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.950267 (+ 59us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.950281 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:36:13.950665 23728 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:46506:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:36:13.952390 23728 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:36:13.954751 23850 tablet_service.cc:1467] Processing CreateTablet for tablet 436528a85f4547b49252087f2c7a4e1d (DEFAULT_TABLE table=test-table [id=c60c1c6820ff490d8c6cb90ed4772963]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:13.954955 23850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 436528a85f4547b49252087f2c7a4e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:13.956544 23808 tablet_bootstrap.cc:492] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd: Bootstrap starting.
I20260929 06:36:13.956875 23808 tablet_bootstrap.cc:654] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:13.957454 23808 tablet_bootstrap.cc:492] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd: No bootstrap required, opened a new log
I20260929 06:36:13.957504 23808 ts_tablet_manager.cc:1397] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260929 06:36:13.957613 23808 raft_consensus.cc:348] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.957659 23808 raft_consensus.cc:374] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:13.957685 23808 raft_consensus.cc:729] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617313279f7b4e258425293ca64a00fd, State: Initialized, Role: FOLLOWER
I20260929 06:36:13.957772 23808 consensus_queue.cc:260] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.957866 23808 ts_tablet_manager.cc:1428] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:13.958570 23923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.954153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:33859 (local address 127.0.0.1:42812)
0929 06:36:13.954204 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.954214 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.954252 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.955236 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.955237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.955239 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:13.955274 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.955276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.956308 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.956309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.957311 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.957313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.958267 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.958268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.958336 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.958340 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.958402 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.958447 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260929 06:36:13.958762 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.954484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51034 (local address 127.9.61.66:43511)
0929 06:36:13.954679 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.954684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.954694 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:36:13.954738 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.954740 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.954752 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.954856 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:13.954977 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.956056 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.957588 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.958300 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.958366 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.958418 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.958618 (+ 200us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.958665 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":98,"threads_started":1}
I20260929 06:36:13.958925 24192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.954487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42812 (local address 127.9.61.67:33859)
0929 06:36:13.954994 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:13.954998 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:13.955007 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:36:13.955044 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:13.955046 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:13.955069 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:13.955369 (+ 300us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:13.955444 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.956207 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.957399 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.958150 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.958235 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.958306 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:13.958793 (+ 487us) server_negotiation.cc:299] Negotiation successful
0929 06:36:13.958839 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":113,"threads_started":1}
I20260929 06:36:13.959159 24191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:13.954213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43511 (local address 127.0.0.1:51034)
0929 06:36:13.954300 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:13.954310 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:13.954355 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:13.954853 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:13.954854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:13.954857 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:13.954900 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.954901 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.956172 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.956174 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.957320 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:13.957323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:13.958369 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:13.958370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:13.958434 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:13.958438 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:36:13.958488 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 06:36:13.958528 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":3,"thread_start_us":51,"threads_started":1}
I20260929 06:36:13.959597 24120 tablet_service.cc:1467] Processing CreateTablet for tablet 436528a85f4547b49252087f2c7a4e1d (DEFAULT_TABLE table=test-table [id=c60c1c6820ff490d8c6cb90ed4772963]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:13.959980 24120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 436528a85f4547b49252087f2c7a4e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:13.959928 23988 tablet_service.cc:1467] Processing CreateTablet for tablet 436528a85f4547b49252087f2c7a4e1d (DEFAULT_TABLE table=test-table [id=c60c1c6820ff490d8c6cb90ed4772963]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:13.960264 23988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 436528a85f4547b49252087f2c7a4e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:13.963552 24195 tablet_bootstrap.cc:492] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395: Bootstrap starting.
I20260929 06:36:13.963865 24196 tablet_bootstrap.cc:492] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31: Bootstrap starting.
I20260929 06:36:13.964334 24195 tablet_bootstrap.cc:654] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:13.964525 24196 tablet_bootstrap.cc:654] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:13.964941 24195 log.cc:824] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:13.965162 24196 log.cc:824] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:13.965811 24195 tablet_bootstrap.cc:492] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395: No bootstrap required, opened a new log
I20260929 06:36:13.965880 24196 tablet_bootstrap.cc:492] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31: No bootstrap required, opened a new log
I20260929 06:36:13.965886 24195 ts_tablet_manager.cc:1397] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:36:13.965932 24196 ts_tablet_manager.cc:1397] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:36:13.967870 24196 raft_consensus.cc:348] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.967870 24195 raft_consensus.cc:348] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.968080 24196 raft_consensus.cc:374] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:13.968080 24195 raft_consensus.cc:374] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:13.968120 24196 raft_consensus.cc:729] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9117d6fea824929a4f8b2cde0c5cd31, State: Initialized, Role: FOLLOWER
I20260929 06:36:13.968120 24195 raft_consensus.cc:729] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f115df1859484fbf8fa73aed298f9395, State: Initialized, Role: FOLLOWER
I20260929 06:36:13.968245 24195 consensus_queue.cc:260] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.968245 24196 consensus_queue.cc:260] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:13.968528 24196 ts_tablet_manager.cc:1428] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:36:13.968537 24195 ts_tablet_manager.cc:1428] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:36:13.968550 24054 heartbeater.cc:503] Master 127.9.61.126:45597 was elected leader, sending a full tablet report...
I20260929 06:36:13.968675 24186 heartbeater.cc:503] Master 127.9.61.126:45597 was elected leader, sending a full tablet report...
W20260929 06:36:14.055256 24055 tablet.cc:2369] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:36:14.107367 23922 raft_consensus.cc:482] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:36:14.107553 23922 raft_consensus.cc:504] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:14.107980 23922 leader_election.cc:288] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859), f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511)
I20260929 06:36:14.111182 24201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.108153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:33859 (local address 127.9.61.65:53487)
0929 06:36:14.108328 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:14.108339 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:14.108391 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:14.108548 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:14.108548 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:14.108550 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:14.108604 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:14.108606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:14.109363 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:14.109364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:14.110241 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:14.110243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:14.110892 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:14.110893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:14.110959 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:14.110963 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:36:14.111025 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 06:36:14.111072 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":15,"thread_start_us":99,"threads_started":1}
I20260929 06:36:14.111199 24192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.108319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:53487 (local address 127.9.61.67:33859)
0929 06:36:14.108371 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:14.108373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:14.108383 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:36:14.108460 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:14.108460 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:14.108472 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:14.108527 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:14.108677 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:14.109291 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:14.110331 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:14.110793 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:14.110846 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:14.110854 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:14.111038 (+ 184us) server_negotiation.cc:299] Negotiation successful
0929 06:36:14.111095 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 06:36:14.111351 23918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.108153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43511 (local address 127.9.61.65:60903)
0929 06:36:14.108204 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:14.108218 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:14.108283 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:14.108463 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:14.108464 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:14.108466 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:14.108880 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:14.108882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:14.109669 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:14.109670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:14.110471 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:14.110473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:14.111091 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:14.111092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:14.111168 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:14.111172 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:36:14.111233 (+ 61us) client_negotiation.cc:240] Negotiation successful
0929 06:36:14.111278 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260929 06:36:14.111380 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.108275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:60903 (local address 127.9.61.66:43511)
0929 06:36:14.108332 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:14.108334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:14.108345 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:36:14.108377 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:14.108377 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:14.108390 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:14.108447 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:14.108970 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:14.109580 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:14.110560 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:14.111018 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:14.111078 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:14.111087 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:14.111259 (+ 172us) server_negotiation.cc:299] Negotiation successful
0929 06:36:14.111302 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:36:14.111676 24008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436528a85f4547b49252087f2c7a4e1d" candidate_uuid: "617313279f7b4e258425293ca64a00fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f115df1859484fbf8fa73aed298f9395" is_pre_election: true
I20260929 06:36:14.111779 24140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436528a85f4547b49252087f2c7a4e1d" candidate_uuid: "617313279f7b4e258425293ca64a00fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" is_pre_election: true
I20260929 06:36:14.111872 24008 raft_consensus.cc:2454] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 617313279f7b4e258425293ca64a00fd in term 0.
I20260929 06:36:14.112003 24140 raft_consensus.cc:2454] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 617313279f7b4e258425293ca64a00fd in term 0.
I20260929 06:36:14.112102 23802 leader_election.cc:302] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617313279f7b4e258425293ca64a00fd, f115df1859484fbf8fa73aed298f9395; no voters:
I20260929 06:36:14.112226 23922 raft_consensus.cc:2781] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:36:14.112309 23922 raft_consensus.cc:482] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:36:14.112346 23922 raft_consensus.cc:3037] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:14.113180 23922 raft_consensus.cc:504] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:14.113329 23922 leader_election.cc:288] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 1 election: Requested vote from peers b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859), f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511)
I20260929 06:36:14.113508 24008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436528a85f4547b49252087f2c7a4e1d" candidate_uuid: "617313279f7b4e258425293ca64a00fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f115df1859484fbf8fa73aed298f9395"
I20260929 06:36:14.113516 24140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436528a85f4547b49252087f2c7a4e1d" candidate_uuid: "617313279f7b4e258425293ca64a00fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9117d6fea824929a4f8b2cde0c5cd31"
I20260929 06:36:14.113607 24008 raft_consensus.cc:3037] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:14.113603 24140 raft_consensus.cc:3037] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:14.114285 24140 raft_consensus.cc:2454] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617313279f7b4e258425293ca64a00fd in term 1.
I20260929 06:36:14.114463 23804 leader_election.cc:302] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 617313279f7b4e258425293ca64a00fd, b9117d6fea824929a4f8b2cde0c5cd31; no voters:
I20260929 06:36:14.114513 24008 raft_consensus.cc:2454] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 617313279f7b4e258425293ca64a00fd in term 1.
I20260929 06:36:14.114604 23922 raft_consensus.cc:2781] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:36:14.114782 23922 raft_consensus.cc:686] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 LEADER]: Becoming Leader. State: Replica: 617313279f7b4e258425293ca64a00fd, State: Running, Role: LEADER
I20260929 06:36:14.114843 23922 consensus_queue.cc:237] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:14.115631 23727 catalog_manager.cc:5495] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 617313279f7b4e258425293ca64a00fd (127.9.61.65). New cstate: current_term: 1 leader_uuid: "617313279f7b4e258425293ca64a00fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } health_report { overall_health: HEALTHY } } }
I20260929 06:36:14.142740 23924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.140273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58108 (local address 127.9.61.65:34903)
0929 06:36:14.140320 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:14.140322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:14.140332 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:36:14.140396 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:14.140397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:14.140418 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:14.140492 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:36:14.140641 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:14.141162 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:14.141923 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:14.142146 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:14.142233 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:14.142392 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:36:14.142502 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:36:14.142579 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:14.142634 (+ 55us) server_negotiation.cc:299] Negotiation successful
0929 06:36:14.142657 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:36:14.144315 24008 raft_consensus.cc:1261] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395 [term 1 FOLLOWER]: Refusing update from remote peer 617313279f7b4e258425293ca64a00fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:36:14.144315 24140 raft_consensus.cc:1261] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31 [term 1 FOLLOWER]: Refusing update from remote peer 617313279f7b4e258425293ca64a00fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:36:14.144670 24202 consensus_queue.cc:1035] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:36:14.144809 23922 consensus_queue.cc:1035] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:36:14.147294 24205 mvcc.cc:205] Tried to move back new op lower bound from 7334558818892546048 to 7334558818775007232. Current Snapshot: MvccSnapshot[applied={T|T < 7334558818892546048}]
I20260929 06:36:14.147665 24207 mvcc.cc:205] Tried to move back new op lower bound from 7334558818892546048 to 7334558818775007232. Current Snapshot: MvccSnapshot[applied={T|T < 7334558818892546048}]
I20260929 06:36:14.148056 24206 mvcc.cc:205] Tried to move back new op lower bound from 7334558818892546048 to 7334558818775007232. Current Snapshot: MvccSnapshot[applied={T|T < 7334558818892546048}]
I20260929 06:36:14.149516 23726 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:46506:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:36:14.149598 23726 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:46506:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:36:14.150338 23726 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Sending DeleteTablet for 3 replicas of tablet 436528a85f4547b49252087f2c7a4e1d
I20260929 06:36:14.150638 24120 tablet_service.cc:1514] Processing DeleteTablet for tablet 436528a85f4547b49252087f2c7a4e1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:14 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:42812
I20260929 06:36:14.150668 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 23766
I20260929 06:36:14.150693 23988 tablet_service.cc:1514] Processing DeleteTablet for tablet 436528a85f4547b49252087f2c7a4e1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:14 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:51034
I20260929 06:36:14.152076 24215 tablet_replica.cc:330] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31: stopping tablet replica
I20260929 06:36:14.152197 24215 raft_consensus.cc:2229] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:36:14.152319 24215 raft_consensus.cc:2258] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:36:14.152498 24216 tablet_replica.cc:330] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395: stopping tablet replica
I20260929 06:36:14.152594 24216 raft_consensus.cc:2229] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:36:14.152694 24216 raft_consensus.cc:2258] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:36:14.152872 24215 ts_tablet_manager.cc:1905] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:36:14.153100 24216 ts_tablet_manager.cc:1905] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:36:14.154615 24215 ts_tablet_manager.cc:1918] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:36:14.154642 24216 ts_tablet_manager.cc:1918] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:36:14.154695 24216 log.cc:1196] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/436528a85f4547b49252087f2c7a4e1d
I20260929 06:36:14.154695 24215 log.cc:1196] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/436528a85f4547b49252087f2c7a4e1d
I20260929 06:36:14.154994 24216 ts_tablet_manager.cc:1939] T 436528a85f4547b49252087f2c7a4e1d P f115df1859484fbf8fa73aed298f9395: Deleting consensus metadata
I20260929 06:36:14.155004 24215 ts_tablet_manager.cc:1939] T 436528a85f4547b49252087f2c7a4e1d P b9117d6fea824929a4f8b2cde0c5cd31: Deleting consensus metadata
I20260929 06:36:14.155402 23712 catalog_manager.cc:4841] TS f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511): tablet 436528a85f4547b49252087f2c7a4e1d (table test-table [id=c60c1c6820ff490d8c6cb90ed4772963]) successfully deleted
I20260929 06:36:14.155473 23714 catalog_manager.cc:4841] TS b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859): tablet 436528a85f4547b49252087f2c7a4e1d (table test-table [id=c60c1c6820ff490d8c6cb90ed4772963]) successfully deleted
W20260929 06:36:14.156062 23712 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:34903 (error 108)
I20260929 06:36:14.156364 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 23921
I20260929 06:36:14.156944 24191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.156443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:34903 (local address 127.0.0.1:58110)
0929 06:36:14.156869 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:14.156905 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:34903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409}
W20260929 06:36:14.157151 23712 catalog_manager.cc:4584] TS 617313279f7b4e258425293ca64a00fd (127.9.61.65:34903): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 436528a85f4547b49252087f2c7a4e1d: Network error: Client connection negotiation failed: client connection to 127.9.61.65:34903: connect: Connection refused (error 111)
I20260929 06:36:14.161439 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 24057
I20260929 06:36:14.165717 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 23695
I20260929 06:36:14.171126 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:45597
--webserver_interface=127.9.61.126
--webserver_port=35195
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:45597
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:14.250985 24218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:14.251188 24218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:14.251211 24218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:14.252385 24218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:36:14.252424 24218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:14.252439 24218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:14.252451 24218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:36:14.252463 24218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:36:14.253906 24218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:45597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:45597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=35195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:14.254135 24218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:14.254356 24218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:14.259198 24226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:14.259210 24224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:14.259409 24218 server_base.cc:1034] running on GCE node
W20260929 06:36:14.259181 24223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:14.259742 24218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:14.260064 24218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:14.261256 24218 hybrid_clock.cc:648] HybridClock initialized: now 1790663774261233 us; error 33 us; skew 500 ppm
Sep 29 06:36:14 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663774, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:14.263707 24218 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:36:14.264161 24218 webserver.cc:460] Webserver started at http://127.9.61.126:35195/ using document root <none> and password file <none>
I20260929 06:36:14.264345 24218 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:14.264386 24218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:14.265636 24218 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:14.266323 24233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:14.266491 24218 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:14.266573 24218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "d3056abe8a9044f3bcdac366895bc743"
format_stamp: "Formatted at 2026-09-29 06:36:12 on dist-test-slave-601b"
server_key: "24c1daec4e89bb10e7c64f7c0d894923"
server_key_iv: "878e9aca05de13c66b30b0f25881363b"
server_key_version: "encryptionkey@0"
I20260929 06:36:14.266897 24218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:14.276767 24218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:14.279148 24218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:14.279313 24218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:14.283917 24218 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:45597
I20260929 06:36:14.283947 24285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:45597 every 8 connection(s)
I20260929 06:36:14.284375 24218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:36:14.285626 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 24218
I20260929 06:36:14.285907 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:34903
--local_ip_for_outbound_sockets=127.9.61.65
--tserver_master_addrs=127.9.61.126:45597
--webserver_port=39633
--webserver_interface=127.9.61.65
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:36:14.286019 24286 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:36:14.286639 24286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Bootstrap starting.
I20260929 06:36:14.295190 24286 log.cc:824] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:14.297485 24286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:36:14.297792 24286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743: Bootstrap complete.
I20260929 06:36:14.300069 24286 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } }
I20260929 06:36:14.300341 24286 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3056abe8a9044f3bcdac366895bc743, State: Initialized, Role: FOLLOWER
I20260929 06:36:14.300532 24286 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } }
I20260929 06:36:14.300621 24286 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:36:14.300675 24286 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:36:14.300735 24286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 2 FOLLOWER]: Advancing to term 3
I20260929 06:36:14.301707 24286 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } }
I20260929 06:36:14.301824 24286 leader_election.cc:302] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3056abe8a9044f3bcdac366895bc743; no voters:
I20260929 06:36:14.302026 24286 leader_election.cc:288] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260929 06:36:14.302102 24290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 06:36:14.302273 24290 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [term 3 LEADER]: Becoming Leader. State: Replica: d3056abe8a9044f3bcdac366895bc743, State: Running, Role: LEADER
I20260929 06:36:14.302307 24286 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:36:14.302433 24290 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } }
I20260929 06:36:14.303407 24291 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "d3056abe8a9044f3bcdac366895bc743" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } } }
I20260929 06:36:14.303495 24291 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:14.303676 24305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:36:14.303853 24292 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3056abe8a9044f3bcdac366895bc743. Latest consensus state: current_term: 3 leader_uuid: "d3056abe8a9044f3bcdac366895bc743" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3056abe8a9044f3bcdac366895bc743" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45597 } } }
I20260929 06:36:14.304123 24292 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3056abe8a9044f3bcdac366895bc743 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:14.304531 24305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:36:14.304630 24305 catalog_manager.cc:1259] Loaded cluster ID: f0996c59d4034fbaa4eeabe271b4a270
I20260929 06:36:14.304673 24305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260929 06:36:14.304881 24305 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fef256809ad google::LogMessage::Fail() at ??:0
@ 0x7fef2568388a google::LogMessage::SendToLog() at ??:0
@ 0x7fef256804de google::LogMessage::Flush() at ??:0
@ 0x7fef25681a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fef2d5a10f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fef2d5aa8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fef2754e0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fef27543954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fef283a76db start_thread at ??:0
@ 0x7fef2417e61f clone at ??:0
W20260929 06:36:14.381361 24288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:14.381557 24288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:14.381582 24288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:14.382718 24288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:14.382757 24288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:14.382783 24288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:36:14.384296 24288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:34903
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=39633
--tserver_master_addrs=127.9.61.126:45597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:14.384538 24288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:14.384785 24288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:14.389688 24325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:14.389694 24323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:14.389694 24322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:14.390229 24288 server_base.cc:1034] running on GCE node
I20260929 06:36:14.390431 24288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:14.390691 24288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:14.391856 24288 hybrid_clock.cc:648] HybridClock initialized: now 1790663774391837 us; error 33 us; skew 500 ppm
Sep 29 06:36:14 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663774, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:14.396473 24288 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:36:14.397571 24288 webserver.cc:460] Webserver started at http://127.9.61.65:39633/ using document root <none> and password file <none>
I20260929 06:36:14.398288 24288 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:14.398362 24288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:14.399852 24288 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:14.400573 24332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:14.400815 24288 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:36:14.400934 24288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "617313279f7b4e258425293ca64a00fd"
format_stamp: "Formatted at 2026-09-29 06:36:12 on dist-test-slave-601b"
server_key: "f2a48fc138c639c4f78471d4311949a5"
server_key_iv: "85b806edd0b5327ebf390f668fbe6b7d"
server_key_version: "encryptionkey@0"
I20260929 06:36:14.401381 24288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:14.417109 24288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:14.419708 24288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:14.419871 24288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:14.420223 24288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:14.420720 24339 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 06:36:14.422211 24288 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 06:36:14.422269 24288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 06:36:14.422305 24288 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 06:36:14.423251 24288 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 06:36:14.423341 24288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:14.423363 24339 tablet_bootstrap.cc:492] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd: Bootstrap starting.
I20260929 06:36:14.431224 24288 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:34903
I20260929 06:36:14.431447 24446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:34903 every 8 connection(s)
I20260929 06:36:14.431813 24288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:36:14.433740 24339 log.cc:824] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:14.435752 24339 tablet_bootstrap.cc:492] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:36:14.436082 24339 tablet_bootstrap.cc:492] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd: Bootstrap complete.
I20260929 06:36:14.437000 24339 ts_tablet_manager.cc:1397] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.010s
I20260929 06:36:14.437980 24339 raft_consensus.cc:348] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:14.438230 24339 raft_consensus.cc:729] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 617313279f7b4e258425293ca64a00fd, State: Initialized, Role: FOLLOWER
I20260929 06:36:14.438392 24339 consensus_queue.cc:260] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:14.438680 24339 ts_tablet_manager.cc:1428] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:36:14.441627 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 24288
I20260929 06:36:14.441939 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:43511
--local_ip_for_outbound_sockets=127.9.61.66
--tserver_master_addrs=127.9.61.126:45597
--webserver_port=45311
--webserver_interface=127.9.61.66
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:14.519456 24449 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:36:14.432558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:54297)
0929 06:36:14.432784 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:14.432833 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:14.433437 (+ 604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:14.519259 (+ 85822us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":117,"threads_started":1}
W20260929 06:36:14.519682 24447 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:45597 (0 consecutive failures): Network error: Failed to ping master at 127.9.61.126:45597: Client connection negotiation failed: client connection to 127.9.61.126:45597: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 06:36:14.520123 24449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.519988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:43279)
0929 06:36:14.520036 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:14.520091 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260929 06:36:14.520563 24449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.520462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:37851)
0929 06:36:14.520514 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:14.520543 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 06:36:14.520705 24447 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:36:14.524742 24452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:14.524925 24452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:14.524948 24452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:14.526021 24452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:14.526054 24452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:14.526079 24452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:36:14.527434 24452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:43511
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=45311
--tserver_master_addrs=127.9.61.126:45597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:14.527609 24452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:14.527772 24452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:14.532502 24457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:14.532506 24460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:14.532500 24458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:14.532784 24452 server_base.cc:1034] running on GCE node
I20260929 06:36:14.533023 24452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:14.533259 24452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:14.534425 24452 hybrid_clock.cc:648] HybridClock initialized: now 1790663774534409 us; error 44 us; skew 500 ppm
Sep 29 06:36:14 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663774, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:14.536898 24452 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:36:14.537276 24452 webserver.cc:460] Webserver started at http://127.9.61.66:45311/ using document root <none> and password file <none>
I20260929 06:36:14.537451 24452 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:14.537490 24452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:14.538698 24452 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:14.539208 24467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:14.539374 24452 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:36:14.539449 24452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "f115df1859484fbf8fa73aed298f9395"
format_stamp: "Formatted at 2026-09-29 06:36:13 on dist-test-slave-601b"
server_key: "1d60769398343a9caaaf9d174e64c72e"
server_key_iv: "7e9f0f48e91e07435fea78042f229cd9"
server_key_version: "encryptionkey@0"
I20260929 06:36:14.539760 24452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:14.555785 24452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:14.558357 24452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:14.558498 24452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:14.558770 24452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:14.559065 24452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:14.559095 24452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:14.559145 24452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:14.559175 24452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:14.564873 24452 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:43511
I20260929 06:36:14.564951 24580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:43511 every 8 connection(s)
I20260929 06:36:14.565290 24452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:36:14.566350 24583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.565945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:59451)
0929 06:36:14.566092 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:14.566194 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":66,"threads_started":1}
I20260929 06:36:14.567037 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 24452
W20260929 06:36:14.567044 24581 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:45597 (0 consecutive failures): Network error: Failed to ping master at 127.9.61.126:45597: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
I20260929 06:36:14.567322 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:33859
--local_ip_for_outbound_sockets=127.9.61.67
--tserver_master_addrs=127.9.61.126:45597
--webserver_port=33069
--webserver_interface=127.9.61.67
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:36:14.567412 24583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.567281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:59521)
0929 06:36:14.567332 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:14.567362 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260929 06:36:14.567807 24583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.567723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:43283)
0929 06:36:14.567769 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:14.567792 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260929 06:36:14.567932 24581 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:36:14.648147 24584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:14.648350 24584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:14.648372 24584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:14.649453 24584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:14.649500 24584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:14.649526 24584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:36:14.651520 24584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:33859
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=33069
--tserver_master_addrs=127.9.61.126:45597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:14.651757 24584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:14.652021 24584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:14.656971 24590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:14.657004 24589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:14.656975 24592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:14.657186 24584 server_base.cc:1034] running on GCE node
I20260929 06:36:14.657379 24584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:14.657605 24584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:14.658756 24584 hybrid_clock.cc:648] HybridClock initialized: now 1790663774658739 us; error 28 us; skew 500 ppm
Sep 29 06:36:14 dist-test-slave-601b krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663774, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:14.661180 24584 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:36:14.661639 24584 webserver.cc:460] Webserver started at http://127.9.61.67:33069/ using document root <none> and password file <none>
I20260929 06:36:14.661873 24584 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:14.661942 24584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:14.663273 24584 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:14.663839 24599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:14.664033 24584 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:36:14.664131 24584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "b9117d6fea824929a4f8b2cde0c5cd31"
format_stamp: "Formatted at 2026-09-29 06:36:13 on dist-test-slave-601b"
server_key: "3f5f8bc098295976b46abeb34929873c"
server_key_iv: "3c0533087be1ed6be8cb6a6220307a2a"
server_key_version: "encryptionkey@0"
I20260929 06:36:14.664463 24584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:14.688577 24584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:14.690505 24584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:14.690667 24584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:14.690902 24584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:14.691218 24584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:14.691274 24584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:14.691316 24584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:14.691342 24584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:14.697077 24584 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:33859
I20260929 06:36:14.697120 24712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:33859 every 8 connection(s)
I20260929 06:36:14.697458 24584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:36:14.698437 24715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.698047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:45233)
0929 06:36:14.698206 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:14.698298 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
W20260929 06:36:14.698864 24713 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:45597 (0 consecutive failures): Network error: Failed to ping master at 127.9.61.126:45597: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
I20260929 06:36:14.699155 24715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.699058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:40045)
0929 06:36:14.699105 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:14.699138 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 06:36:14.699426 24715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:14.699353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:49119)
0929 06:36:14.699391 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:14.699412 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260929 06:36:14.699560 24713 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 06:36:14.702340 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 24584
I20260929 06:36:15.521343 24717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:15.521103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:40851)
0929 06:36:15.521235 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:15.521278 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":64,"threads_started":1}
I20260929 06:36:15.568456 24718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:15.568259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:44049)
0929 06:36:15.568370 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:15.568407 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":56,"threads_started":1}
I20260929 06:36:15.700193 24719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:15.699910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:37877)
0929 06:36:15.700105 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:15.700141 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":118,"threads_started":1}
I20260929 06:36:16.115319 24720 raft_consensus.cc:482] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:36:16.115449 24720 raft_consensus.cc:504] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:16.115897 24720 leader_election.cc:288] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859), f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511)
Sep 29 06:36:16 dist-test-slave-601b krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663774, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.67@KRBTEST.COM
Sep 29 06:36:16 dist-test-slave-601b krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663774, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.66@KRBTEST.COM
I20260929 06:36:16.129287 24724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:16.116281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:53089 (local address 127.9.61.66:43511)
0929 06:36:16.116437 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:16.116444 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:16.116467 (+ 23us) server_negotiation.cc:407] Connection header received
0929 06:36:16.117053 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:16.117056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:16.117111 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:16.117278 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:16.118302 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:16.119738 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:16.121372 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:16.121931 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:16.122062 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:16.125040 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:16.125044 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:16.125045 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:16.125065 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:16.126898 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:16.127635 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:16.127638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:16.127638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:16.127772 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:16.128138 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:16.128139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:16.128140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:16.128509 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:16.128608 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:16.129004 (+ 396us) server_negotiation.cc:299] Negotiation successful
0929 06:36:16.129177 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":65,"threads_started":1}
I20260929 06:36:16.129276 24723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:16.116253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:35397 (local address 127.9.61.67:33859)
0929 06:36:16.116420 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:16.116432 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:16.116467 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:36:16.117044 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:16.117048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:16.117111 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:16.117278 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:16.118301 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:16.119738 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:16.121342 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:16.121912 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:16.122030 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:16.124681 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:16.124685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:16.124685 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:16.124697 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:16.126933 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:16.127639 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:16.127641 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:16.127641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:16.127772 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:16.128138 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:16.128139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:16.128140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:16.128509 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:16.128617 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:16.129004 (+ 387us) server_negotiation.cc:299] Negotiation successful
0929 06:36:16.129160 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":53,"threads_started":1}
I20260929 06:36:16.129262 24721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:16.116152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:43511 (local address 127.9.61.65:53089)
0929 06:36:16.116294 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:16.116304 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:16.116367 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:16.117354 (+ 987us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:16.117354 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:16.117860 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:16.118141 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:16.118148 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:16.119872 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:16.119873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:16.121252 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:16.121253 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:16.122046 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:16.122047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:16.122143 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:16.122764 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:16.122773 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:16.124927 (+ 2154us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:16.127052 (+ 2125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:16.127053 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:16.127053 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:16.127539 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:16.127852 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:16.127853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:16.127853 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:16.128060 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:16.128598 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:16.128605 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:16.128784 (+ 179us) client_negotiation.cc:769] Sending connection context
0929 06:36:16.128901 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 06:36:16.129132 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":100,"thread_start_us":48,"threads_started":1}
I20260929 06:36:16.129276 24722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:16.116101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:33859 (local address 127.9.61.65:35397)
0929 06:36:16.116291 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:16.116304 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:16.116367 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:16.117350 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:16.117353 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:16.117859 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:16.118141 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:16.118149 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:16.119860 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:16.119861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:16.121245 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:16.121249 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:16.122007 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:16.122009 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:16.122137 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:16.122865 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:16.122872 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:16.124544 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:16.127036 (+ 2492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:16.127045 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:16.127048 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:16.127547 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:16.127852 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:16.127853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:16.127853 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:16.128054 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:16.128598 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:16.128605 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:16.128784 (+ 179us) client_negotiation.cc:769] Sending connection context
0929 06:36:16.128901 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 06:36:16.129186 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":205,"thread_start_us":109,"threads_started":1}
W20260929 06:36:16.130846 24335 leader_election.cc:341] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859): Not found: Tablet not found: 436528a85f4547b49252087f2c7a4e1d
W20260929 06:36:16.130945 24333 leader_election.cc:341] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511): Not found: Tablet not found: 436528a85f4547b49252087f2c7a4e1d
I20260929 06:36:16.130993 24333 leader_election.cc:302] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 617313279f7b4e258425293ca64a00fd; no voters: b9117d6fea824929a4f8b2cde0c5cd31, f115df1859484fbf8fa73aed298f9395
I20260929 06:36:16.131101 24720 raft_consensus.cc:2726] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:36:16.522145 24722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:16.521892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:53875)
0929 06:36:16.522055 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:16.522101 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260929 06:36:16.569149 24725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:16.568924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:58549)
0929 06:36:16.569045 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:16.569096 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260929 06:36:16.700883 24726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:16.700667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:33555)
0929 06:36:16.700792 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:16.700828 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":72,"threads_started":1}
I20260929 06:36:17.522944 24727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:17.522702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:54279)
0929 06:36:17.522845 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:17.522885 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
I20260929 06:36:17.569833 24728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:17.569608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:47211)
0929 06:36:17.569756 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:17.569790 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":74,"threads_started":1}
I20260929 06:36:17.701462 24729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:17.701264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:56599)
0929 06:36:17.701387 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:17.701424 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":58,"threads_started":1}
I20260929 06:36:18.246343 24730 raft_consensus.cc:482] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:36:18.246443 24730 raft_consensus.cc:504] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:18.246658 24730 leader_election.cc:288] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859), f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511)
W20260929 06:36:18.247131 24335 leader_election.cc:341] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859): Not found: Tablet not found: 436528a85f4547b49252087f2c7a4e1d
W20260929 06:36:18.247197 24333 leader_election.cc:341] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511): Not found: Tablet not found: 436528a85f4547b49252087f2c7a4e1d
I20260929 06:36:18.247228 24333 leader_election.cc:302] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 617313279f7b4e258425293ca64a00fd; no voters: b9117d6fea824929a4f8b2cde0c5cd31, f115df1859484fbf8fa73aed298f9395
I20260929 06:36:18.247296 24730 raft_consensus.cc:2726] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:36:18.523691 24731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:18.523443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:57945)
0929 06:36:18.523589 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:18.523629 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":94,"threads_started":1}
I20260929 06:36:18.570510 24732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:18.570241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:38607)
0929 06:36:18.570392 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:18.570430 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":59,"threads_started":1}
I20260929 06:36:18.702229 24733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:18.702010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:42243)
0929 06:36:18.702134 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:18.702173 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260929 06:36:19.524593 24734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:19.524254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:42367)
0929 06:36:19.524506 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:19.524544 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":99,"threads_started":1}
I20260929 06:36:19.571210 24735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:19.570999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:52299)
0929 06:36:19.571132 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:19.571168 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":61,"threads_started":1}
I20260929 06:36:19.703106 24736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:19.702793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:37671)
0929 06:36:19.703005 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:19.703058 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":113,"threads_started":1}
I20260929 06:36:20.525465 24737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:20.525168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:57149)
0929 06:36:20.525327 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:20.525398 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":66,"threads_started":1}
I20260929 06:36:20.571907 24738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:20.571700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:58007)
0929 06:36:20.571827 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:20.571862 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":57,"threads_started":1}
I20260929 06:36:20.703846 24739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:20.703652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:53749)
0929 06:36:20.703771 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:20.703803 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":60,"threads_started":1}
I20260929 06:36:20.816185 24740 raft_consensus.cc:482] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:36:20.816278 24740 raft_consensus.cc:504] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:20.816484 24740 leader_election.cc:288] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859), f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511)
W20260929 06:36:20.817039 24335 leader_election.cc:341] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859): Not found: Tablet not found: 436528a85f4547b49252087f2c7a4e1d
W20260929 06:36:20.817129 24333 leader_election.cc:341] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511): Not found: Tablet not found: 436528a85f4547b49252087f2c7a4e1d
I20260929 06:36:20.817204 24333 leader_election.cc:302] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 617313279f7b4e258425293ca64a00fd; no voters: b9117d6fea824929a4f8b2cde0c5cd31, f115df1859484fbf8fa73aed298f9395
I20260929 06:36:20.817297 24740 raft_consensus.cc:2726] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:36:21.526149 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:21.525921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:43155)
0929 06:36:21.526068 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:21.526103 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":75,"threads_started":1}
I20260929 06:36:21.572629 24742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:21.572396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:44939)
0929 06:36:21.572548 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:21.572583 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":92,"threads_started":1}
I20260929 06:36:21.704474 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:21.704279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:60983)
0929 06:36:21.704391 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:21.704432 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":58,"threads_started":1}
I20260929 06:36:22.526824 24744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:22.526601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:50395)
0929 06:36:22.526739 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:22.526777 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260929 06:36:22.573319 24745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:22.573085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:43333)
0929 06:36:22.573222 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:22.573274 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":72,"threads_started":1}
I20260929 06:36:22.705185 24746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:22.704970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:56841)
0929 06:36:22.705103 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:22.705140 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
I20260929 06:36:23.527491 24747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:23.527259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:41081)
0929 06:36:23.527403 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:23.527443 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":64,"threads_started":1}
I20260929 06:36:23.574070 24748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:23.573804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:49349)
0929 06:36:23.573955 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:23.573996 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":64,"threads_started":1}
I20260929 06:36:23.673085 24749 raft_consensus.cc:482] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:36:23.673197 24749 raft_consensus.cc:504] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:23.673416 24749 leader_election.cc:288] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859), f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511)
W20260929 06:36:23.673763 24333 leader_election.cc:341] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511): Not found: Tablet not found: 436528a85f4547b49252087f2c7a4e1d
W20260929 06:36:23.673861 24335 leader_election.cc:341] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859): Not found: Tablet not found: 436528a85f4547b49252087f2c7a4e1d
I20260929 06:36:23.673980 24335 leader_election.cc:302] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 617313279f7b4e258425293ca64a00fd; no voters: b9117d6fea824929a4f8b2cde0c5cd31, f115df1859484fbf8fa73aed298f9395
I20260929 06:36:23.674077 24749 raft_consensus.cc:2726] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:36:23.705955 24750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:23.705726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:49895)
0929 06:36:23.705872 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:23.705911 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260929 06:36:24.528344 24751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:24.528101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:50645)
0929 06:36:24.528221 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:24.528260 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260929 06:36:24.574714 24752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:24.574503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:34537)
0929 06:36:24.574636 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:24.574670 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":61,"threads_started":1}
I20260929 06:36:24.706596 24753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:24.706394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:51833)
0929 06:36:24.706511 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:24.706551 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
I20260929 06:36:25.529011 24754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:25.528810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:57125)
0929 06:36:25.528930 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:25.528964 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":62,"threads_started":1}
I20260929 06:36:25.575484 24755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:25.575256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:55653)
0929 06:36:25.575393 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:25.575433 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":71,"threads_started":1}
I20260929 06:36:25.707216 24756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:25.707003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:56159)
0929 06:36:25.707136 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:25.707172 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":58,"threads_started":1}
I20260929 06:36:26.529733 24757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:26.529498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:35015)
0929 06:36:26.529645 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:26.529686 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":61,"threads_started":1}
I20260929 06:36:26.576246 24758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:26.576000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:56667)
0929 06:36:26.576158 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:26.576198 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":58,"threads_started":1}
I20260929 06:36:26.707856 24759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:26.707658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:48423)
0929 06:36:26.707769 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:26.707805 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":60,"threads_started":1}
I20260929 06:36:27.530431 24760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:27.530218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:49771)
0929 06:36:27.530345 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:27.530383 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260929 06:36:27.577042 24761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:27.576775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:50375)
0929 06:36:27.576945 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:27.576992 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":64,"threads_started":1}
I20260929 06:36:27.708618 24762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:27.708395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:39053)
0929 06:36:27.708513 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:27.708565 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":59,"threads_started":1}
I20260929 06:36:28.490980 24763 raft_consensus.cc:482] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:36:28.491092 24763 raft_consensus.cc:504] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9117d6fea824929a4f8b2cde0c5cd31" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 33859 } } peers { permanent_uuid: "f115df1859484fbf8fa73aed298f9395" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 43511 } } peers { permanent_uuid: "617313279f7b4e258425293ca64a00fd" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 34903 } }
I20260929 06:36:28.491319 24763 leader_election.cc:288] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859), f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511)
W20260929 06:36:28.491771 24333 leader_election.cc:341] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f115df1859484fbf8fa73aed298f9395 (127.9.61.66:43511): Not found: Tablet not found: 436528a85f4547b49252087f2c7a4e1d
W20260929 06:36:28.491847 24335 leader_election.cc:341] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9117d6fea824929a4f8b2cde0c5cd31 (127.9.61.67:33859): Not found: Tablet not found: 436528a85f4547b49252087f2c7a4e1d
I20260929 06:36:28.491888 24335 leader_election.cc:302] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 617313279f7b4e258425293ca64a00fd; no voters: b9117d6fea824929a4f8b2cde0c5cd31, f115df1859484fbf8fa73aed298f9395
I20260929 06:36:28.491988 24763 raft_consensus.cc:2726] T 436528a85f4547b49252087f2c7a4e1d P 617313279f7b4e258425293ca64a00fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:36:28.531129 24764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:28.530906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:38965)
0929 06:36:28.531043 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:28.531083 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
I20260929 06:36:28.577965 24765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:28.577736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:54989)
0929 06:36:28.577872 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:28.577916 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260929 06:36:28.709374 24766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:28.709144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:58683)
0929 06:36:28.709276 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:28.709325 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":60,"threads_started":1}
I20260929 06:36:29.532037 24767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:29.531796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.65:59673)
0929 06:36:29.531924 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:29.531989 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":57,"threads_started":1}
I20260929 06:36:29.578686 24768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:29.578491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.66:60937)
0929 06:36:29.578598 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:29.578630 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":56,"threads_started":1}
I20260929 06:36:29.710216 24769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:29.709968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:45597 (local address 127.9.61.67:34627)
0929 06:36:29.710122 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:29.710169 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:45597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":77,"threads_started":1}
I20260929 06:36:29.710755 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 24288
I20260929 06:36:29.715282 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 24452
I20260929 06:36:29.719440 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 24584
2026-09-29T06:36:29Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18221 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:36:29 dist-test-slave-601b krb5kdc[24772](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:36:29 dist-test-slave-601b krb5kdc[24772](info): set up 2 sockets
Sep 29 06:36:29 dist-test-slave-601b krb5kdc[24772](info): commencing operation
krb5kdc: starting...
W20260929 06:36:30.760125 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:36:30 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:36:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:36:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:36:30.876966 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:32981
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:32981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:30.958369 24785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:30.958616 24785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:30.958652 24785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:30.959798 24785 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260929 06:36:30.959862 24785 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260929 06:36:30.959883 24785 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260929 06:36:30.959903 24785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:36:30.959968 24785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:30.960013 24785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:30.960047 24785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:36:30.960074 24785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:36:30.961550 24785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:32981
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:32981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:30.961841 24785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:30.962073 24785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:36:30.967226 24785 server_base.cc:1034] running on GCE node
W20260929 06:36:30.967208 24793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:30.967226 24790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:30.967208 24791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:30.967702 24785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:30.968093 24785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:30.969264 24785 hybrid_clock.cc:648] HybridClock initialized: now 1790663790969253 us; error 36 us; skew 500 ppm
Sep 29 06:36:30 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663790, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:30.971844 24785 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:36:30.972280 24785 webserver.cc:460] Webserver started at http://127.9.61.126:39595/ using document root <none> and password file <none>
I20260929 06:36:30.972517 24785 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:30.972561 24785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:30.972703 24785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:36:30.973775 24785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "c86df3246b124a88bbec6806a99d7f50"
format_stamp: "Formatted at 2026-09-29 06:36:30 on dist-test-slave-601b"
server_key: "2bf9853f023bc3a7401072b184ca1f54"
server_key_iv: "ffa28177acfeb79f469bf5293b902eb5"
server_key_version: "encryptionkey@0"
I20260929 06:36:30.974131 24785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "c86df3246b124a88bbec6806a99d7f50"
format_stamp: "Formatted at 2026-09-29 06:36:30 on dist-test-slave-601b"
server_key: "2bf9853f023bc3a7401072b184ca1f54"
server_key_iv: "ffa28177acfeb79f469bf5293b902eb5"
server_key_version: "encryptionkey@0"
I20260929 06:36:30.975556 24785 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:36:30.976369 24800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:30.976604 24785 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:36:30.976703 24785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "c86df3246b124a88bbec6806a99d7f50"
format_stamp: "Formatted at 2026-09-29 06:36:30 on dist-test-slave-601b"
server_key: "2bf9853f023bc3a7401072b184ca1f54"
server_key_iv: "ffa28177acfeb79f469bf5293b902eb5"
server_key_version: "encryptionkey@0"
I20260929 06:36:30.976776 24785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:30.989920 24785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:30.992408 24785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:30.992581 24785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:30.996495 24785 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:32981
I20260929 06:36:30.996603 24852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:32981 every 8 connection(s)
I20260929 06:36:30.996918 24785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:36:30.997885 24853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:31.000463 24853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Bootstrap starting.
I20260929 06:36:31.001106 24853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:31.001428 24853 log.cc:824] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:31.001581 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 24785
I20260929 06:36:31.001703 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:36:31.001969 9461 external_mini_cluster.cc:1428] Setting key 01d3af152811e98d6a3a589baee0357e
I20260929 06:36:31.002239 24853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: No bootstrap required, opened a new log
I20260929 06:36:31.004405 24853 raft_consensus.cc:348] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } }
I20260929 06:36:31.004644 24853 raft_consensus.cc:374] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:31.004725 24853 raft_consensus.cc:729] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c86df3246b124a88bbec6806a99d7f50, State: Initialized, Role: FOLLOWER
I20260929 06:36:31.004886 24853 consensus_queue.cc:260] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } }
I20260929 06:36:31.004966 24853 raft_consensus.cc:388] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:36:31.005007 24853 raft_consensus.cc:482] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:36:31.005059 24853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:31.005642 24853 raft_consensus.cc:504] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } }
I20260929 06:36:31.005738 24853 leader_election.cc:302] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c86df3246b124a88bbec6806a99d7f50; no voters:
I20260929 06:36:31.005949 24853 leader_election.cc:288] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:36:31.005986 24858 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:36:31.006108 24858 raft_consensus.cc:686] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 1 LEADER]: Becoming Leader. State: Replica: c86df3246b124a88bbec6806a99d7f50, State: Running, Role: LEADER
I20260929 06:36:31.006249 24853 sys_catalog.cc:564] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:36:31.006254 24858 consensus_queue.cc:237] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } }
I20260929 06:36:31.006683 24860 sys_catalog.cc:455] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c86df3246b124a88bbec6806a99d7f50. Latest consensus state: current_term: 1 leader_uuid: "c86df3246b124a88bbec6806a99d7f50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } } }
I20260929 06:36:31.006822 24860 sys_catalog.cc:458] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:31.007052 24859 sys_catalog.cc:455] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c86df3246b124a88bbec6806a99d7f50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } } }
I20260929 06:36:31.007169 24859 sys_catalog.cc:458] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:31.007454 24865 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:36:31.008078 24865 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 29 06:36:31 dist-test-slave-601b krb5kdc[24772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:31.010798 24865 catalog_manager.cc:1347] Generated new cluster ID: f5a3c5b522294c5fb0a27fcecacea377
I20260929 06:36:31.010852 24865 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:36:31.014329 24857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.002704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58048 (local address 127.9.61.126:32981)
0929 06:36:31.002897 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:31.002906 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:31.002939 (+ 33us) server_negotiation.cc:407] Connection header received
0929 06:36:31.003582 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:31.003590 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:31.003640 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:31.003785 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:31.004488 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.005945 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.007072 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.007631 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.007747 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.010757 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:31.010761 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:31.010761 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:31.010771 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:31.012635 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:31.013005 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:31.013008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:31.013008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:31.013095 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:31.013289 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:31.013290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:31.013291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:31.013527 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:31.013677 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:31.014053 (+ 376us) server_negotiation.cc:299] Negotiation successful
0929 06:36:31.014180 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":83,"threads_started":1}
I20260929 06:36:31.030277 24865 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:36:31.030840 24865 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:36:31.033560 24865 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Generated new TSK 0
I20260929 06:36:31.033735 24865 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:36:31.066725 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32981
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:31.170858 24879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:31.171088 24879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:31.171115 24879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:31.172524 24879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:31.172570 24879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:31.172600 24879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:36:31.174242 24879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:31.174554 24879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:31.174827 24879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:31.180465 24887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:31.180621 24879 server_base.cc:1034] running on GCE node
W20260929 06:36:31.180492 24884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:31.180447 24885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:31.181041 24879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:31.181257 24879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:31.182425 24879 hybrid_clock.cc:648] HybridClock initialized: now 1790663791182415 us; error 34 us; skew 500 ppm
Sep 29 06:36:31 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663791, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:31.185058 24879 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:36:31.185711 24879 webserver.cc:460] Webserver started at http://127.9.61.65:38017/ using document root <none> and password file <none>
I20260929 06:36:31.186002 24879 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:31.186084 24879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:31.186250 24879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:36:31.187475 24879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "599e7d6e22b945b0b5b26ff37bc12508"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "69a20d3300c4e0aa9cfaf97bbb6df1c8"
server_key_iv: "2138aa8118ac1dd0f36f0e37f515a3e8"
server_key_version: "encryptionkey@0"
I20260929 06:36:31.187884 24879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "599e7d6e22b945b0b5b26ff37bc12508"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "69a20d3300c4e0aa9cfaf97bbb6df1c8"
server_key_iv: "2138aa8118ac1dd0f36f0e37f515a3e8"
server_key_version: "encryptionkey@0"
I20260929 06:36:31.189383 24879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:31.190183 24894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:31.190369 24879 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:31.190511 24879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "599e7d6e22b945b0b5b26ff37bc12508"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "69a20d3300c4e0aa9cfaf97bbb6df1c8"
server_key_iv: "2138aa8118ac1dd0f36f0e37f515a3e8"
server_key_version: "encryptionkey@0"
I20260929 06:36:31.190593 24879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:31.197312 24879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:31.199584 24879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:31.199743 24879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:31.200008 24879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:31.200320 24879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:31.200376 24879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:31.200419 24879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:31.200445 24879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:31.206526 24879 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:37129
I20260929 06:36:31.206610 25007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:37129 every 8 connection(s)
I20260929 06:36:31.207001 24879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:36:31.212296 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 24879
I20260929 06:36:31.212426 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:36:31.212630 9461 external_mini_cluster.cc:1428] Setting key 438827192aeeca80b6d0d3519147dbe2
Sep 29 06:36:31 dist-test-slave-601b krb5kdc[24772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663791, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:31.217074 24857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.207838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:49049 (local address 127.9.61.126:32981)
0929 06:36:31.207890 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:31.207893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:31.208190 (+ 297us) server_negotiation.cc:407] Connection header received
0929 06:36:31.208713 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:31.208714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:31.208723 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:31.208778 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:31.209733 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.210244 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.211217 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.211433 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.211493 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.214022 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:31.214024 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:31.214029 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:31.214036 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:31.215551 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:31.216090 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:31.216091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:31.216091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:31.216144 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:31.216432 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:31.216432 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:31.216433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:31.216536 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:31.216587 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:31.216928 (+ 341us) server_negotiation.cc:299] Negotiation successful
0929 06:36:31.216998 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:36:31.217545 25010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.207824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:49049)
0929 06:36:31.208054 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:31.208110 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:31.208620 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:31.208835 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:31.208839 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:31.209428 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:31.209640 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.209645 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.210328 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.210328 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.211129 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.211130 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.211514 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.211514 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.211619 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.212176 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:31.212185 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:31.213916 (+ 1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:31.215638 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:31.215645 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:31.215648 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:31.216022 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:31.216214 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:31.216214 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:31.216215 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:31.216365 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:31.216603 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:31.216609 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:31.216783 (+ 174us) client_negotiation.cc:769] Sending connection context
0929 06:36:31.216896 (+ 113us) client_negotiation.cc:240] Negotiation successful
0929 06:36:31.217233 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":90,"threads_started":1}
I20260929 06:36:31.218221 25008 heartbeater.cc:347] Connected to a master server at 127.9.61.126:32981
I20260929 06:36:31.218348 25008 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:31.218562 25008 heartbeater.cc:511] Master 127.9.61.126:32981 requested a full tablet report, sending...
I20260929 06:36:31.219141 24817 ts_manager.cc:194] Registered new tserver with Master: 599e7d6e22b945b0b5b26ff37bc12508 (127.9.61.65:37129)
I20260929 06:36:31.219782 24817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:49049
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:36:31.240183 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32981
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:31.330338 25013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:31.330554 25013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:31.330579 25013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:31.331769 25013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:31.331807 25013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:31.331835 25013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:36:31.333367 25013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:31.333571 25013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:31.333755 25013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:31.339202 25021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:31.339226 25018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:31.339205 25019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:31.339519 25013 server_base.cc:1034] running on GCE node
I20260929 06:36:31.339744 25013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:31.340013 25013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:31.341156 25013 hybrid_clock.cc:648] HybridClock initialized: now 1790663791341028 us; error 142 us; skew 500 ppm
Sep 29 06:36:31 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663791, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:31.344290 25013 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:36:31.344806 25013 webserver.cc:460] Webserver started at http://127.9.61.66:41317/ using document root <none> and password file <none>
I20260929 06:36:31.345045 25013 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:31.345114 25013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:31.345249 25013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:36:31.346294 25013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "5d635b1b9cf5442bb0327f562b16c9c2"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "cbc95a7b68596296c5c08adfe02ddf34"
server_key_iv: "ef4746e7dd69237e4ab20df7f06aca0f"
server_key_version: "encryptionkey@0"
I20260929 06:36:31.346676 25013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "5d635b1b9cf5442bb0327f562b16c9c2"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "cbc95a7b68596296c5c08adfe02ddf34"
server_key_iv: "ef4746e7dd69237e4ab20df7f06aca0f"
server_key_version: "encryptionkey@0"
I20260929 06:36:31.348018 25013 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:36:31.348731 25028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:31.348901 25013 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:36:31.348997 25013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "5d635b1b9cf5442bb0327f562b16c9c2"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "cbc95a7b68596296c5c08adfe02ddf34"
server_key_iv: "ef4746e7dd69237e4ab20df7f06aca0f"
server_key_version: "encryptionkey@0"
I20260929 06:36:31.349082 25013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:31.359874 25013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:31.362217 25013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:31.362390 25013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:31.362609 25013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:31.362913 25013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:31.362972 25013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:31.363006 25013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:31.363034 25013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:31.368836 25013 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:33941
I20260929 06:36:31.368883 25141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:33941 every 8 connection(s)
I20260929 06:36:31.369196 25013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:36:31 dist-test-slave-601b krb5kdc[24772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663791, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:31.375164 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 25013
I20260929 06:36:31.375286 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:36:31.375494 9461 external_mini_cluster.cc:1428] Setting key e1e37051427348bcefeaa0f5ca07f51e
I20260929 06:36:31.378677 24857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.369915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:39047 (local address 127.9.61.126:32981)
0929 06:36:31.369977 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:31.369979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:31.370146 (+ 167us) server_negotiation.cc:407] Connection header received
0929 06:36:31.370608 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:31.370609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:31.370617 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:31.370678 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:31.371622 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.372200 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.373162 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.373353 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.373450 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.375576 (+ 2126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:31.375578 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:31.375578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:31.375587 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:31.377191 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:31.377675 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:31.377676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:31.377677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:31.377738 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:31.378018 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:31.378019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:31.378019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:31.378141 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:31.378218 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:31.378501 (+ 283us) server_negotiation.cc:299] Negotiation successful
0929 06:36:31.378584 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:36:31.378896 25144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.369842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:39047)
0929 06:36:31.369998 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:31.370048 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:31.370526 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:31.370750 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:31.370753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:31.371324 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:31.371515 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.371520 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.372281 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.372282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.373075 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.373077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.373468 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.373468 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.373566 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.374014 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:31.374030 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:31.375477 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:31.377312 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:31.377320 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:31.377323 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:31.377588 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:31.377818 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:31.377819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:31.377819 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:31.377941 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:31.378210 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:31.378216 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:31.378365 (+ 149us) client_negotiation.cc:769] Sending connection context
0929 06:36:31.378479 (+ 114us) client_negotiation.cc:240] Negotiation successful
0929 06:36:31.378644 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260929 06:36:31.379429 25142 heartbeater.cc:347] Connected to a master server at 127.9.61.126:32981
I20260929 06:36:31.379541 25142 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:31.379721 25142 heartbeater.cc:511] Master 127.9.61.126:32981 requested a full tablet report, sending...
I20260929 06:36:31.380158 24817 ts_manager.cc:194] Registered new tserver with Master: 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941)
I20260929 06:36:31.380594 24817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:39047
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:36:31.400614 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32981
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:31.482084 25147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:31.482313 25147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:31.482357 25147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:31.483654 25147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:31.483706 25147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:31.483763 25147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:36:31.485424 25147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:31.485703 25147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:31.485960 25147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:31.491312 25152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:31.491490 25147 server_base.cc:1034] running on GCE node
W20260929 06:36:31.491312 25155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:31.491312 25153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:31.491881 25147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:31.492184 25147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:31.493338 25147 hybrid_clock.cc:648] HybridClock initialized: now 1790663791493289 us; error 66 us; skew 500 ppm
Sep 29 06:36:31 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663791, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:31.500924 25147 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:36:31.501492 25147 webserver.cc:460] Webserver started at http://127.9.61.67:39737/ using document root <none> and password file <none>
I20260929 06:36:31.501751 25147 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:31.501822 25147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:31.501984 25147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:36:31.503170 25147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "fe9516a5dacb4139b3513f1519d18878"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "bda1ba171273bb7be2ee8e827fd3c4b0"
server_key_iv: "d20118929d3167ac10e99d2ca8d3aadf"
server_key_version: "encryptionkey@0"
I20260929 06:36:31.503572 25147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "fe9516a5dacb4139b3513f1519d18878"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "bda1ba171273bb7be2ee8e827fd3c4b0"
server_key_iv: "d20118929d3167ac10e99d2ca8d3aadf"
server_key_version: "encryptionkey@0"
I20260929 06:36:31.505216 25147 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:36:31.506202 25162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:31.506722 25147 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:31.506844 25147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "fe9516a5dacb4139b3513f1519d18878"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "bda1ba171273bb7be2ee8e827fd3c4b0"
server_key_iv: "d20118929d3167ac10e99d2ca8d3aadf"
server_key_version: "encryptionkey@0"
I20260929 06:36:31.506946 25147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:31.514580 25147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:31.516743 25147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:31.516861 25147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:31.517066 25147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:31.517388 25147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:31.517469 25147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:31.517494 25147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:31.517506 25147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:31.523343 25147 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:38513
I20260929 06:36:31.523416 25275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:38513 every 8 connection(s)
I20260929 06:36:31.523779 25147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:36:31.525396 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 25147
I20260929 06:36:31.525511 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:36:31.525681 9461 external_mini_cluster.cc:1428] Setting key 978b903d38599151c8c4a4a855f9ee9a
Sep 29 06:36:31 dist-test-slave-601b krb5kdc[24772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663791, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:31.533414 24857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.524640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:35853 (local address 127.9.61.126:32981)
0929 06:36:31.524713 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:31.524715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:31.524898 (+ 183us) server_negotiation.cc:407] Connection header received
0929 06:36:31.525453 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:31.525455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:31.525467 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:31.525521 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:31.526796 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.527297 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.528425 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.528630 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.528716 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.530790 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:31.530792 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:31.530792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:31.530800 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:31.531915 (+ 1115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:31.532413 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:31.532415 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:31.532415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:31.532475 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:31.532727 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:31.532728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:31.532729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:31.532850 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:31.532928 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:31.533203 (+ 275us) server_negotiation.cc:299] Negotiation successful
0929 06:36:31.533288 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 06:36:31.533640 25278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.524601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:35853)
0929 06:36:31.524763 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:31.524809 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:31.525334 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:31.525606 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:31.525617 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:31.526439 (+ 822us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:31.526701 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.526708 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.527403 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.527404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.528316 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.528319 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.528725 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.528726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.528857 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.529344 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:31.529352 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:31.530680 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:31.532077 (+ 1397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:31.532084 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:31.532086 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:31.532318 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:31.532542 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:31.532543 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:31.532543 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:31.532659 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:31.532919 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:31.532925 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:31.533071 (+ 146us) client_negotiation.cc:769] Sending connection context
0929 06:36:31.533182 (+ 111us) client_negotiation.cc:240] Negotiation successful
0929 06:36:31.533375 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260929 06:36:31.534171 25276 heartbeater.cc:347] Connected to a master server at 127.9.61.126:32981
I20260929 06:36:31.534261 25276 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:31.534416 25276 heartbeater.cc:511] Master 127.9.61.126:32981 requested a full tablet report, sending...
I20260929 06:36:31.534770 24817 ts_manager.cc:194] Registered new tserver with Master: fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513)
I20260929 06:36:31.535169 24817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:35853
I20260929 06:36:31.537442 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:36:31.544458 24857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.538768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58050 (local address 127.9.61.126:32981)
0929 06:36:31.538825 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:31.538827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:31.538910 (+ 83us) server_negotiation.cc:407] Connection header received
0929 06:36:31.538952 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:31.538953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:31.538961 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:31.539010 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:31.539520 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.540086 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.540774 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.540958 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.541007 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.542218 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:31.542219 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:31.542219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:31.542225 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:31.543423 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:31.543739 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:31.543739 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:31.543740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:31.543788 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:31.544004 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:31.544005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:31.544005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:31.544146 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:31.544226 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:31.544316 (+ 90us) server_negotiation.cc:299] Negotiation successful
0929 06:36:31.544377 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260929 06:36:31.546175 24817 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58050:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:36:31.547742 24817 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:36:31.554833 25291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.550360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53962 (local address 127.9.61.65:37129)
0929 06:36:31.550567 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:31.550572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:31.550688 (+ 116us) server_negotiation.cc:407] Connection header received
0929 06:36:31.550827 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:31.550830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:31.550845 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:31.551236 (+ 391us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:31.551310 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.552462 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.553640 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.554377 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.554463 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.554536 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:31.554697 (+ 161us) server_negotiation.cc:299] Negotiation successful
0929 06:36:31.554742 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":112,"threads_started":1}
I20260929 06:36:31.554857 25288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.550210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:37129 (local address 127.0.0.1:53962)
0929 06:36:31.550578 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:31.550622 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:31.550707 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:31.551075 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:31.551076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:31.551080 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:31.551153 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.551156 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.552602 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.552603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.553552 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.553555 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.554490 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.554491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.554578 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.554596 (+ 18us) client_negotiation.cc:769] Sending connection context
0929 06:36:31.554676 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 06:36:31.554743 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":9,"thread_start_us":49,"threads_started":1}
I20260929 06:36:31.554857 25287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.550396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:38513 (local address 127.0.0.1:51216)
0929 06:36:31.550820 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:31.550829 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:31.550891 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:31.551230 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:31.551231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:31.551233 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:31.551266 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.551267 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.552570 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.552571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.553692 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.553693 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.554492 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.554492 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.554578 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.554596 (+ 18us) client_negotiation.cc:769] Sending connection context
0929 06:36:31.554676 (+ 80us) client_negotiation.cc:240] Negotiation successful
0929 06:36:31.554743 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":71,"thread_start_us":70,"threads_started":1}
I20260929 06:36:31.555100 25292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.550502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51216 (local address 127.9.61.67:38513)
0929 06:36:31.550669 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:31.550674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:31.550939 (+ 265us) server_negotiation.cc:407] Connection header received
0929 06:36:31.550988 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:31.550990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:31.551005 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:31.551088 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:31.551339 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.552465 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.553768 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.554416 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.554479 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.554530 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:31.554982 (+ 452us) server_negotiation.cc:299] Negotiation successful
0929 06:36:31.555024 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":95,"threads_started":1}
I20260929 06:36:31.555751 25289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.550345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48006 (local address 127.9.61.66:33941)
0929 06:36:31.550649 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:31.550653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:31.550744 (+ 91us) server_negotiation.cc:407] Connection header received
0929 06:36:31.550829 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:31.550831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:31.550849 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:31.550937 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:31.551138 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.552143 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.554569 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.555287 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.555352 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.555412 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:31.555613 (+ 201us) server_negotiation.cc:299] Negotiation successful
0929 06:36:31.555659 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":93,"threads_started":1}
I20260929 06:36:31.555727 24942 tablet_service.cc:1467] Processing CreateTablet for tablet b70febf96dad423294668d64fa297c73 (DEFAULT_TABLE table=test-table [id=11116e1c6f2747fc94548366e33e7392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:31.556149 24942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b70febf96dad423294668d64fa297c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:31.556232 25210 tablet_service.cc:1467] Processing CreateTablet for tablet b70febf96dad423294668d64fa297c73 (DEFAULT_TABLE table=test-table [id=11116e1c6f2747fc94548366e33e7392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:31.556610 25210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b70febf96dad423294668d64fa297c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:31.557201 25290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.550210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:33941 (local address 127.0.0.1:48006)
0929 06:36:31.550684 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:31.550695 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:31.550754 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:31.550977 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:31.550980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:31.550982 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:31.551051 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.551053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.552240 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.552241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.553665 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.553668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.555446 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.555447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.555536 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.555539 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:36:31.555595 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 06:36:31.557097 (+ 1502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"mutex_wait_us":2,"thread_start_us":87,"threads_started":1}
I20260929 06:36:31.560671 25076 tablet_service.cc:1467] Processing CreateTablet for tablet b70febf96dad423294668d64fa297c73 (DEFAULT_TABLE table=test-table [id=11116e1c6f2747fc94548366e33e7392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:31.561259 25076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b70febf96dad423294668d64fa297c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:31.561429 25294 tablet_bootstrap.cc:492] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Bootstrap starting.
I20260929 06:36:31.561501 25293 tablet_bootstrap.cc:492] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878: Bootstrap starting.
I20260929 06:36:31.562163 25294 tablet_bootstrap.cc:654] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:31.562297 25293 tablet_bootstrap.cc:654] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:31.562978 25293 log.cc:824] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:31.563019 25294 log.cc:824] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:31.563985 25293 tablet_bootstrap.cc:492] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878: No bootstrap required, opened a new log
I20260929 06:36:31.564144 25293 ts_tablet_manager.cc:1397] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:36:31.565642 25297 tablet_bootstrap.cc:492] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2: Bootstrap starting.
I20260929 06:36:31.566062 25294 tablet_bootstrap.cc:492] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: No bootstrap required, opened a new log
I20260929 06:36:31.566150 25294 ts_tablet_manager.cc:1397] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260929 06:36:31.566334 25297 tablet_bootstrap.cc:654] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:31.566459 25293 raft_consensus.cc:348] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } }
I20260929 06:36:31.566672 25293 raft_consensus.cc:374] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:31.566718 25293 raft_consensus.cc:729] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9516a5dacb4139b3513f1519d18878, State: Initialized, Role: FOLLOWER
I20260929 06:36:31.566875 25293 consensus_queue.cc:260] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } }
I20260929 06:36:31.566953 25297 log.cc:824] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:31.567209 25276 heartbeater.cc:503] Master 127.9.61.126:32981 was elected leader, sending a full tablet report...
I20260929 06:36:31.567207 25293 ts_tablet_manager.cc:1428] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:36:31.568068 25297 tablet_bootstrap.cc:492] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2: No bootstrap required, opened a new log
I20260929 06:36:31.568140 25297 ts_tablet_manager.cc:1397] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:36:31.568693 25294 raft_consensus.cc:348] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } }
I20260929 06:36:31.568878 25294 raft_consensus.cc:374] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:31.568930 25294 raft_consensus.cc:729] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599e7d6e22b945b0b5b26ff37bc12508, State: Initialized, Role: FOLLOWER
I20260929 06:36:31.569036 25294 consensus_queue.cc:260] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } }
I20260929 06:36:31.569301 25294 ts_tablet_manager.cc:1428] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:36:31.569334 25008 heartbeater.cc:503] Master 127.9.61.126:32981 was elected leader, sending a full tablet report...
I20260929 06:36:31.570290 25297 raft_consensus.cc:348] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } }
I20260929 06:36:31.570470 25297 raft_consensus.cc:374] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:31.570508 25297 raft_consensus.cc:729] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d635b1b9cf5442bb0327f562b16c9c2, State: Initialized, Role: FOLLOWER
I20260929 06:36:31.570870 25297 consensus_queue.cc:260] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } }
I20260929 06:36:31.571286 25142 heartbeater.cc:503] Master 127.9.61.126:32981 was elected leader, sending a full tablet report...
I20260929 06:36:31.571271 25297 ts_tablet_manager.cc:1428] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260929 06:36:31.619810 25143 tablet.cc:2369] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:36:31.698805 25300 raft_consensus.cc:482] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:36:31.698967 25300 raft_consensus.cc:504] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } }
I20260929 06:36:31.699390 25300 leader_election.cc:288] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513), 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941)
I20260929 06:36:31.702247 25292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.699637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:60141 (local address 127.9.61.67:38513)
0929 06:36:31.699687 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:31.699689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:31.699700 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:36:31.699730 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:31.699731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:31.699743 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:31.699808 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:31.699991 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.700465 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.701468 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.701889 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.701972 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.701984 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:31.702143 (+ 159us) server_negotiation.cc:299] Negotiation successful
0929 06:36:31.702179 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:36:31.702286 25010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.699547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:38513 (local address 127.9.61.65:60141)
0929 06:36:31.699607 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:31.699620 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:31.699662 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:31.699813 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:31.699814 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:31.699815 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:31.699889 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.699891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.700551 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.700551 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.701351 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.701353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.701970 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.701971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.702056 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.702059 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:36:31.702125 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 06:36:31.702171 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":46}
I20260929 06:36:31.702307 25289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.699728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:44191 (local address 127.9.61.66:33941)
0929 06:36:31.699801 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:31.699804 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:31.699813 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:36:31.699848 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:31.699849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:31.699860 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:31.699929 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:31.700118 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.700576 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.701550 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.701929 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.702024 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.702034 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:31.702193 (+ 159us) server_negotiation.cc:299] Negotiation successful
0929 06:36:31.702233 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260929 06:36:31.702533 25302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.699572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:33941 (local address 127.9.61.65:44191)
0929 06:36:31.699707 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:31.699716 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:31.699764 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:31.699934 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:31.699935 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:31.699958 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:31.700042 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.700044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.700669 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.700669 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.701440 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:31.701442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.702020 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.702021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:31.702099 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.702102 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:36:31.702183 (+ 81us) client_negotiation.cc:240] Negotiation successful
0929 06:36:31.702225 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":67,"threads_started":1}
I20260929 06:36:31.702673 25230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b70febf96dad423294668d64fa297c73" candidate_uuid: "599e7d6e22b945b0b5b26ff37bc12508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9516a5dacb4139b3513f1519d18878" is_pre_election: true
I20260929 06:36:31.702859 25230 raft_consensus.cc:2454] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599e7d6e22b945b0b5b26ff37bc12508 in term 0.
I20260929 06:36:31.702847 25096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b70febf96dad423294668d64fa297c73" candidate_uuid: "599e7d6e22b945b0b5b26ff37bc12508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" is_pre_election: true
I20260929 06:36:31.702986 25096 raft_consensus.cc:2454] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599e7d6e22b945b0b5b26ff37bc12508 in term 0.
I20260929 06:36:31.703120 24898 leader_election.cc:302] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599e7d6e22b945b0b5b26ff37bc12508, fe9516a5dacb4139b3513f1519d18878; no voters:
I20260929 06:36:31.703249 25300 raft_consensus.cc:2781] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:36:31.703342 25300 raft_consensus.cc:482] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:36:31.703378 25300 raft_consensus.cc:3037] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:31.704172 25300 raft_consensus.cc:504] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } }
I20260929 06:36:31.704326 25300 leader_election.cc:288] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 1 election: Requested vote from peers fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513), 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941)
I20260929 06:36:31.704530 25096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b70febf96dad423294668d64fa297c73" candidate_uuid: "599e7d6e22b945b0b5b26ff37bc12508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d635b1b9cf5442bb0327f562b16c9c2"
I20260929 06:36:31.704530 25230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b70febf96dad423294668d64fa297c73" candidate_uuid: "599e7d6e22b945b0b5b26ff37bc12508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9516a5dacb4139b3513f1519d18878"
I20260929 06:36:31.704615 25230 raft_consensus.cc:3037] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:31.704615 25096 raft_consensus.cc:3037] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:31.705554 25096 raft_consensus.cc:2454] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599e7d6e22b945b0b5b26ff37bc12508 in term 1.
I20260929 06:36:31.705546 25230 raft_consensus.cc:2454] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599e7d6e22b945b0b5b26ff37bc12508 in term 1.
I20260929 06:36:31.705745 24897 leader_election.cc:302] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599e7d6e22b945b0b5b26ff37bc12508, 5d635b1b9cf5442bb0327f562b16c9c2; no voters:
I20260929 06:36:31.705853 25300 raft_consensus.cc:2781] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:36:31.706014 25300 raft_consensus.cc:686] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 LEADER]: Becoming Leader. State: Replica: 599e7d6e22b945b0b5b26ff37bc12508, State: Running, Role: LEADER
I20260929 06:36:31.706131 25300 consensus_queue.cc:237] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } }
I20260929 06:36:31.707013 24817 catalog_manager.cc:5495] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 599e7d6e22b945b0b5b26ff37bc12508 (127.9.61.65). New cstate: current_term: 1 leader_uuid: "599e7d6e22b945b0b5b26ff37bc12508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } health_report { overall_health: UNKNOWN } } }
W20260929 06:36:31.707792 25009 tablet.cc:2369] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:36:31.739681 25291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.736947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53968 (local address 127.9.61.65:37129)
0929 06:36:31.737010 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:31.737012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:31.737023 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:36:31.737109 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:31.737110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:31.737142 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:31.737219 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:36:31.737361 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.737930 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.738778 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:31.739037 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:31.739109 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:31.739293 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:36:31.739417 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:36:31.739519 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:31.739538 (+ 19us) server_negotiation.cc:299] Negotiation successful
0929 06:36:31.739564 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 06:36:31.741693 25230 raft_consensus.cc:1261] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878 [term 1 FOLLOWER]: Refusing update from remote peer 599e7d6e22b945b0b5b26ff37bc12508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:36:31.741693 25096 raft_consensus.cc:1261] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2 [term 1 FOLLOWER]: Refusing update from remote peer 599e7d6e22b945b0b5b26ff37bc12508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:36:31.742107 25303 consensus_queue.cc:1035] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:36:31.742296 25300 consensus_queue.cc:1035] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:36:31.747560 24816 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58050:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:36:31.747684 24816 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58050:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:36:31.748517 24816 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Sending DeleteTablet for 3 replicas of tablet b70febf96dad423294668d64fa297c73
I20260929 06:36:31.748899 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 24879
I20260929 06:36:31.748888 25210 tablet_service.cc:1514] Processing DeleteTablet for tablet b70febf96dad423294668d64fa297c73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:31 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:51216
I20260929 06:36:31.748894 25076 tablet_service.cc:1514] Processing DeleteTablet for tablet b70febf96dad423294668d64fa297c73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:31 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:48006
I20260929 06:36:31.749739 25315 tablet_replica.cc:330] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878: stopping tablet replica
I20260929 06:36:31.749883 25315 raft_consensus.cc:2229] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:36:31.750023 25315 raft_consensus.cc:2258] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:36:31.750515 25315 ts_tablet_manager.cc:1905] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:36:31.751917 25316 tablet_replica.cc:330] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2: stopping tablet replica
I20260929 06:36:31.752131 25316 raft_consensus.cc:2229] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:36:31.752140 25315 ts_tablet_manager.cc:1918] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:36:31.752255 25315 log.cc:1196] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/b70febf96dad423294668d64fa297c73
I20260929 06:36:31.752269 25316 raft_consensus.cc:2258] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:36:31.752579 25315 ts_tablet_manager.cc:1939] T b70febf96dad423294668d64fa297c73 P fe9516a5dacb4139b3513f1519d18878: Deleting consensus metadata
I20260929 06:36:31.752737 25316 ts_tablet_manager.cc:1905] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:36:31.753073 24804 catalog_manager.cc:4841] TS fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513): tablet b70febf96dad423294668d64fa297c73 (table test-table [id=11116e1c6f2747fc94548366e33e7392]) successfully deleted
I20260929 06:36:31.754297 25316 ts_tablet_manager.cc:1918] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:36:31.754370 25316 log.cc:1196] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/b70febf96dad423294668d64fa297c73
W20260929 06:36:31.754551 24804 connection.cc:535] client connection to 127.9.61.65:37129 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260929 06:36:31.754654 24804 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 06:36:31.754739 25316 ts_tablet_manager.cc:1939] T b70febf96dad423294668d64fa297c73 P 5d635b1b9cf5442bb0327f562b16c9c2: Deleting consensus metadata
I20260929 06:36:31.754827 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 25013
I20260929 06:36:31.755837 25290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.755690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:37129 (local address 127.0.0.1:53984)
0929 06:36:31.755760 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:31.755807 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260929 06:36:31.755992 24804 catalog_manager.cc:4584] TS 599e7d6e22b945b0b5b26ff37bc12508 (127.9.61.65:37129): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b70febf96dad423294668d64fa297c73: Network error: Client connection negotiation failed: client connection to 127.9.61.65:37129: connect: Connection refused (error 111)
I20260929 06:36:31.759779 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 25147
I20260929 06:36:31.759944 25290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:31.759799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:33941 (local address 127.0.0.1:48010)
0929 06:36:31.759842 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:31.759902 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.66:33941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260929 06:36:31.764592 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 24785
I20260929 06:36:51.770046 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:32981
--webserver_interface=127.9.61.126
--webserver_port=39595
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:32981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:36:51.849999 25318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:51.850244 25318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:51.850281 25318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:51.851441 25318 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260929 06:36:51.851511 25318 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260929 06:36:51.851533 25318 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260929 06:36:51.851552 25318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:36:51.851584 25318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:51.851616 25318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:51.851642 25318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:36:51.851665 25318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:36:51.853142 25318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:32981
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:32981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=39595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:51.853433 25318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:51.853657 25318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:51.862037 25324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:51.862059 25327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:51.862044 25325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:51.862372 25318 server_base.cc:1034] running on GCE node
I20260929 06:36:51.862641 25318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:51.863001 25318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:51.864141 25318 hybrid_clock.cc:648] HybridClock initialized: now 1790663811864117 us; error 42 us; skew 500 ppm
Sep 29 06:36:51 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663811, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:51.866591 25318 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:36:51.866981 25318 webserver.cc:460] Webserver started at http://127.9.61.126:39595/ using document root <none> and password file <none>
I20260929 06:36:51.867172 25318 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:51.867237 25318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:51.868671 25318 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:36:51.869285 25334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:51.869463 25318 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:36:51.869546 25318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "c86df3246b124a88bbec6806a99d7f50"
format_stamp: "Formatted at 2026-09-29 06:36:30 on dist-test-slave-601b"
server_key: "2bf9853f023bc3a7401072b184ca1f54"
server_key_iv: "ffa28177acfeb79f469bf5293b902eb5"
server_key_version: "encryptionkey@0"
I20260929 06:36:51.869918 25318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:51.896412 25318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:51.898828 25318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:51.898939 25318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:51.902761 25318 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:32981
I20260929 06:36:51.902823 25386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:32981 every 8 connection(s)
I20260929 06:36:51.903227 25318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:36:51.904804 25387 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:36:51.905090 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 25318
I20260929 06:36:51.905454 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:37129
--local_ip_for_outbound_sockets=127.9.61.65
--tserver_master_addrs=127.9.61.126:32981
--webserver_port=38017
--webserver_interface=127.9.61.65
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:36:51.905813 25387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Bootstrap starting.
I20260929 06:36:51.914674 25387 log.cc:824] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:51.916823 25387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:36:51.917131 25387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Bootstrap complete.
I20260929 06:36:51.919512 25387 raft_consensus.cc:348] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } }
I20260929 06:36:51.919777 25387 raft_consensus.cc:729] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c86df3246b124a88bbec6806a99d7f50, State: Initialized, Role: FOLLOWER
I20260929 06:36:51.920002 25387 consensus_queue.cc:260] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } }
I20260929 06:36:51.920100 25387 raft_consensus.cc:388] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:36:51.920161 25387 raft_consensus.cc:482] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:36:51.920210 25387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 1 FOLLOWER]: Advancing to term 2
I20260929 06:36:51.921203 25387 raft_consensus.cc:504] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } }
I20260929 06:36:51.921350 25387 leader_election.cc:302] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c86df3246b124a88bbec6806a99d7f50; no voters:
I20260929 06:36:51.921597 25387 leader_election.cc:288] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260929 06:36:51.921614 25391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 06:36:51.921752 25391 raft_consensus.cc:686] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 2 LEADER]: Becoming Leader. State: Replica: c86df3246b124a88bbec6806a99d7f50, State: Running, Role: LEADER
I20260929 06:36:51.921895 25387 sys_catalog.cc:564] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:36:51.921904 25391 consensus_queue.cc:237] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } }
I20260929 06:36:51.922340 25392 sys_catalog.cc:455] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c86df3246b124a88bbec6806a99d7f50. Latest consensus state: current_term: 2 leader_uuid: "c86df3246b124a88bbec6806a99d7f50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } } }
I20260929 06:36:51.922359 25393 sys_catalog.cc:455] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c86df3246b124a88bbec6806a99d7f50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } } }
I20260929 06:36:51.922436 25392 sys_catalog.cc:458] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:51.922469 25393 sys_catalog.cc:458] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: This master's current role is: LEADER
I20260929 06:36:51.922683 25398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:36:51.923578 25398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:36:51.923727 25398 catalog_manager.cc:1259] Loaded cluster ID: f5a3c5b522294c5fb0a27fcecacea377
I20260929 06:36:51.924039 25398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:36:51.925244 25398 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:36:51.925423 25398 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Loaded TSK: 0
I20260929 06:36:51.937952 25398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Generated new TSK 1
I20260929 06:36:51.938069 25398 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 06:36:51.990484 25389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:51.990696 25389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:51.990722 25389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:51.991906 25389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:51.991999 25389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:51.992070 25389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:36:51.993947 25389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:37129
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=38017
--tserver_master_addrs=127.9.61.126:32981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:51.994233 25389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:51.994508 25389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:51.999996 25414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:52.000093 25417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:52.000770 25415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:52.001204 25389 server_base.cc:1034] running on GCE node
I20260929 06:36:52.001466 25389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:52.001786 25389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:52.005062 25389 hybrid_clock.cc:648] HybridClock initialized: now 1790663812005040 us; error 36 us; skew 500 ppm
Sep 29 06:36:52 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:52.008420 25389 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:36:52.009061 25389 webserver.cc:460] Webserver started at http://127.9.61.65:38017/ using document root <none> and password file <none>
I20260929 06:36:52.009325 25389 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:52.009418 25389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:52.011025 25389 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260929 06:36:52.011796 25424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:52.012056 25389 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:36:52.012156 25389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "599e7d6e22b945b0b5b26ff37bc12508"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "69a20d3300c4e0aa9cfaf97bbb6df1c8"
server_key_iv: "2138aa8118ac1dd0f36f0e37f515a3e8"
server_key_version: "encryptionkey@0"
I20260929 06:36:52.012593 25389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:52.021716 25389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:52.024293 25389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:52.024466 25389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:52.024722 25389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:52.025202 25431 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 06:36:52.027377 25389 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 06:36:52.027455 25389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 06:36:52.027516 25389 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 06:36:52.028303 25389 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 06:36:52.028362 25389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260929 06:36:52.028447 25431 tablet_bootstrap.cc:492] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Bootstrap starting.
I20260929 06:36:52.034937 25389 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:37129
I20260929 06:36:52.035099 25538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:37129 every 8 connection(s)
I20260929 06:36:52.035404 25389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:36:52.039984 25431 log.cc:824] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:52.041378 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 25389
I20260929 06:36:52.041711 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:33941
--local_ip_for_outbound_sockets=127.9.61.66
--tserver_master_addrs=127.9.61.126:32981
--webserver_port=41317
--webserver_interface=127.9.61.66
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:36:52.043201 25431 tablet_bootstrap.cc:492] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:36:52.043593 25431 tablet_bootstrap.cc:492] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Bootstrap complete.
Sep 29 06:36:52 dist-test-slave-601b krb5kdc[24772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:52.044890 25431 ts_tablet_manager.cc:1397] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.012s
I20260929 06:36:52.046277 25431 raft_consensus.cc:348] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } }
I20260929 06:36:52.046635 25431 raft_consensus.cc:729] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599e7d6e22b945b0b5b26ff37bc12508, State: Initialized, Role: FOLLOWER
I20260929 06:36:52.046818 25431 consensus_queue.cc:260] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } }
I20260929 06:36:52.047117 25431 ts_tablet_manager.cc:1428] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260929 06:36:52.048704 25541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.036206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:44717)
0929 06:36:52.036516 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:52.036553 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:52.037014 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:52.037656 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:52.037660 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:52.038036 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:52.038243 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.038248 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.039597 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.039598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.040827 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.040830 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.042056 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.042057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.042234 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.042892 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:52.042903 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:52.044606 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:52.046737 (+ 2131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:52.046745 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:52.046747 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:52.047067 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:52.047448 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:52.047449 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:52.047449 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:52.047593 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:52.048033 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:52.048040 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:52.048189 (+ 149us) client_negotiation.cc:769] Sending connection context
0929 06:36:52.048306 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 06:36:52.048499 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":86,"threads_started":1}
I20260929 06:36:52.048729 25542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.036303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:44717 (local address 127.9.61.126:32981)
0929 06:36:52.037183 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:52.037191 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:52.037219 (+ 28us) server_negotiation.cc:407] Connection header received
0929 06:36:52.037375 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:52.037381 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:52.037436 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:52.037584 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:52.038371 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.039461 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.040935 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.041538 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.041679 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.044748 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:52.044752 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:52.044753 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:52.044765 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:52.046600 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:52.047226 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:52.047229 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:52.047229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:52.047358 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:52.047664 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:52.047665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:52.047665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:52.047909 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:52.048053 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:52.048379 (+ 326us) server_negotiation.cc:299] Negotiation successful
0929 06:36:52.048509 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":830,"thread_start_us":76,"threads_started":1}
I20260929 06:36:52.050066 25539 heartbeater.cc:347] Connected to a master server at 127.9.61.126:32981
I20260929 06:36:52.050174 25539 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:52.050356 25539 heartbeater.cc:511] Master 127.9.61.126:32981 requested a full tablet report, sending...
I20260929 06:36:52.051136 25351 ts_manager.cc:194] Registered new tserver with Master: 599e7d6e22b945b0b5b26ff37bc12508 (127.9.61.65:37129)
I20260929 06:36:52.052212 25351 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:44717
I20260929 06:36:52.053179 25539 heartbeater.cc:503] Master 127.9.61.126:32981 was elected leader, sending a full tablet report...
Sep 29 06:36:52 dist-test-slave-601b krb5kdc[24772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663811, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for kudu/127.9.61.65@KRBTEST.COM
I20260929 06:36:52.062208 25546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.051784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:37129 (local address 127.0.0.1:47952)
0929 06:36:52.052073 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:52.052108 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:52.052172 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:52.052479 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:52.052484 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:52.052832 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:52.052912 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.052914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.054059 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.054060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.055145 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.055149 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.055632 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.055634 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.055748 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.056394 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:52.056400 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:52.058396 (+ 1996us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:52.060797 (+ 2401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:52.060805 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:52.060808 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:52.061096 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:52.061363 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:52.061364 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:52.061364 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:52.061436 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:52.061802 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:52.061809 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:52.061866 (+ 57us) client_negotiation.cc:769] Sending connection context
0929 06:36:52.061956 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 06:36:52.062081 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":117,"threads_started":1}
I20260929 06:36:52.062229 25547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.051850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47952 (local address 127.9.61.65:37129)
0929 06:36:52.052294 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:52.052298 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:52.052307 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:36:52.052339 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:52.052341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:52.052358 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:52.052416 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:52.053004 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.053970 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.055244 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.055527 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.055583 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.058509 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:52.058518 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:52.058519 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:52.058527 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:52.060696 (+ 2169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:52.061207 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:52.061211 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:52.061211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:52.061282 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:52.061512 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:52.061513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:52.061514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:52.061723 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:52.061815 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:52.062014 (+ 199us) server_negotiation.cc:299] Negotiation successful
0929 06:36:52.062120 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":116,"threads_started":1}
I20260929 06:36:52.063206 25473 tablet_service.cc:1514] Processing DeleteTablet for tablet b70febf96dad423294668d64fa297c73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:31 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:47952
I20260929 06:36:52.063851 25548 tablet_replica.cc:330] stopping tablet replica
I20260929 06:36:52.064009 25548 raft_consensus.cc:2229] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:36:52.064087 25548 raft_consensus.cc:2258] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:36:52.064414 25548 ts_tablet_manager.cc:1905] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:36:52.066895 25548 ts_tablet_manager.cc:1918] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:36:52.066974 25548 log.cc:1196] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal/wals/b70febf96dad423294668d64fa297c73
I20260929 06:36:52.067214 25548 ts_tablet_manager.cc:1939] T b70febf96dad423294668d64fa297c73 P 599e7d6e22b945b0b5b26ff37bc12508: Deleting consensus metadata
I20260929 06:36:52.067816 25338 catalog_manager.cc:4841] TS 599e7d6e22b945b0b5b26ff37bc12508 (127.9.61.65:37129): tablet b70febf96dad423294668d64fa297c73 (table test-table [id=11116e1c6f2747fc94548366e33e7392]) successfully deleted
W20260929 06:36:52.137670 25544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:52.137887 25544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:52.137912 25544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:52.139184 25544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:52.139235 25544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:52.139264 25544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:36:52.140810 25544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:33941
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=41317
--tserver_master_addrs=127.9.61.126:32981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:52.141081 25544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:52.141328 25544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:36:52.146786 25544 server_base.cc:1034] running on GCE node
W20260929 06:36:52.146692 25556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:52.146665 25553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:52.146665 25554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:52.147130 25544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:52.147405 25544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:52.148553 25544 hybrid_clock.cc:648] HybridClock initialized: now 1790663812148535 us; error 41 us; skew 500 ppm
Sep 29 06:36:52 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:52.151024 25544 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:36:52.151503 25544 webserver.cc:460] Webserver started at http://127.9.61.66:41317/ using document root <none> and password file <none>
I20260929 06:36:52.151748 25544 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:52.151837 25544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:52.153282 25544 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:52.153930 25563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:52.154238 25544 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:52.154345 25544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "5d635b1b9cf5442bb0327f562b16c9c2"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "cbc95a7b68596296c5c08adfe02ddf34"
server_key_iv: "ef4746e7dd69237e4ab20df7f06aca0f"
server_key_version: "encryptionkey@0"
I20260929 06:36:52.154708 25544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:52.182703 25544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:52.184764 25544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:52.184957 25544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:52.185230 25544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:52.185561 25544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:52.185616 25544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:52.185793 25544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:52.185868 25544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:52.192487 25544 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:33941
I20260929 06:36:52.192538 25676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:33941 every 8 connection(s)
I20260929 06:36:52.192974 25544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:36:52.195917 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 25544
I20260929 06:36:52.196265 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:38513
--local_ip_for_outbound_sockets=127.9.61.67
--tserver_master_addrs=127.9.61.126:32981
--webserver_port=39737
--webserver_interface=127.9.61.67
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 29 06:36:52 dist-test-slave-601b krb5kdc[24772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:52.203886 25542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.193803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:39155 (local address 127.9.61.126:32981)
0929 06:36:52.193868 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:52.193870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:52.194109 (+ 239us) server_negotiation.cc:407] Connection header received
0929 06:36:52.194678 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:52.194680 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:52.194695 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:52.194743 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:52.195764 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.196511 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.197558 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.197790 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.197882 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.200452 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:52.200455 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:52.200455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:52.200465 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:52.202300 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:52.202774 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:52.202776 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:52.202776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:52.202845 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:52.203131 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:52.203132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:52.203133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:52.203295 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:52.203377 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:52.203636 (+ 259us) server_negotiation.cc:299] Negotiation successful
0929 06:36:52.203745 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 06:36:52.203903 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.193809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:39155)
0929 06:36:52.193978 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:52.194016 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:52.194530 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:52.194831 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:52.194835 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:52.195428 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:52.195640 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.195645 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.196626 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.196627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.197446 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.197448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.197894 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.197895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.198026 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.198661 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:52.198673 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:52.200348 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:52.202405 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:52.202411 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:52.202414 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:52.202693 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:52.202935 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:52.202936 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:52.202936 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:52.203046 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:52.203368 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:52.203372 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:52.203497 (+ 125us) client_negotiation.cc:769] Sending connection context
0929 06:36:52.203587 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 06:36:52.203725 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
I20260929 06:36:52.204627 25677 heartbeater.cc:347] Connected to a master server at 127.9.61.126:32981
I20260929 06:36:52.204751 25677 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:52.204981 25677 heartbeater.cc:511] Master 127.9.61.126:32981 requested a full tablet report, sending...
I20260929 06:36:52.205437 25351 ts_manager.cc:194] Registered new tserver with Master: 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941)
I20260929 06:36:52.205829 25351 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:39155
W20260929 06:36:52.281966 25680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:36:52.282205 25680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:36:52.282232 25680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:36:52.283507 25680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:36:52.283568 25680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:36:52.283598 25680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:36:52.285229 25680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:38513
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=39737
--tserver_master_addrs=127.9.61.126:32981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:36:52.285501 25680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:36:52.285751 25680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:36:52.290992 25685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:52.291007 25688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:36:52.291023 25686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:36:52.291287 25680 server_base.cc:1034] running on GCE node
I20260929 06:36:52.291513 25680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:36:52.291791 25680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:36:52.292979 25680 hybrid_clock.cc:648] HybridClock initialized: now 1790663812292962 us; error 48 us; skew 500 ppm
Sep 29 06:36:52 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:36:52.295640 25680 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:36:52.296172 25680 webserver.cc:460] Webserver started at http://127.9.61.67:39737/ using document root <none> and password file <none>
I20260929 06:36:52.296402 25680 fs_manager.cc:359] Metadata directory not provided
I20260929 06:36:52.296487 25680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:36:52.297942 25680 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:52.298723 25695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:52.298908 25680 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:36:52.299016 25680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "fe9516a5dacb4139b3513f1519d18878"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "bda1ba171273bb7be2ee8e827fd3c4b0"
server_key_iv: "d20118929d3167ac10e99d2ca8d3aadf"
server_key_version: "encryptionkey@0"
I20260929 06:36:52.299384 25680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:36:52.318135 25680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:36:52.320775 25680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:36:52.320956 25680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:36:52.321297 25680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:36:52.321656 25680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:36:52.321713 25680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:52.321749 25680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:36:52.321776 25680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:36:52.328044 25680 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:38513
I20260929 06:36:52.328116 25808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:38513 every 8 connection(s)
I20260929 06:36:52.328504 25680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:36:52.332173 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 25680
Sep 29 06:36:52 dist-test-slave-601b krb5kdc[24772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:36:52.338601 25542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.329290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:43863 (local address 127.9.61.126:32981)
0929 06:36:52.329339 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:52.329341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:52.329563 (+ 222us) server_negotiation.cc:407] Connection header received
0929 06:36:52.330035 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:52.330037 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:52.330046 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:52.330109 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:52.331108 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.331606 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.332819 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.333126 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.333178 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.335646 (+ 2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:52.335648 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:52.335648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:52.335656 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:52.337082 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:52.337540 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:52.337541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:52.337542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:52.337602 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:52.337886 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:52.337887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:52.337888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:52.337998 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:52.338077 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:52.338383 (+ 306us) server_negotiation.cc:299] Negotiation successful
0929 06:36:52.338509 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:36:52.338840 25811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.329281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:43863)
0929 06:36:52.329427 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:52.329467 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:52.329948 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:52.330181 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:52.330184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:52.330782 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:36:52.330983 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.330988 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.331699 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.331700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.332691 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.332693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.333221 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.333222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.333389 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.334084 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:36:52.334095 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:36:52.335470 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:36:52.337191 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:52.337199 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:52.337201 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:52.337457 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:52.337689 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:36:52.337690 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:36:52.337690 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:36:52.337807 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:36:52.338082 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:36:52.338088 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:36:52.338234 (+ 146us) client_negotiation.cc:769] Sending connection context
0929 06:36:52.338351 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 06:36:52.338527 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
I20260929 06:36:52.339326 25809 heartbeater.cc:347] Connected to a master server at 127.9.61.126:32981
I20260929 06:36:52.339447 25809 heartbeater.cc:464] Registering TS with master...
I20260929 06:36:52.339666 25809 heartbeater.cc:511] Master 127.9.61.126:32981 requested a full tablet report, sending...
I20260929 06:36:52.340137 25351 ts_manager.cc:194] Registered new tserver with Master: fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513)
I20260929 06:36:52.340137 25813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.332658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38250 (local address 127.9.61.126:32981)
0929 06:36:52.332800 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:52.332802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:52.332895 (+ 93us) server_negotiation.cc:407] Connection header received
0929 06:36:52.332939 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:52.332939 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:52.332951 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:52.333024 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:52.333810 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.334296 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.335054 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.335316 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.335392 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.336839 (+ 1447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:52.336841 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:52.336841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:52.336848 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:52.338496 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:52.338921 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:52.338922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:52.338923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:52.338982 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:52.339498 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:52.339499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:52.339499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:52.339628 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:52.339803 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:52.339908 (+ 105us) server_negotiation.cc:299] Negotiation successful
0929 06:36:52.340037 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":63,"threads_started":1}
I20260929 06:36:52.340593 25351 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:43863
I20260929 06:36:52.341447 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:36:52.344544 25813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.341888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38254 (local address 127.9.61.126:32981)
0929 06:36:52.341961 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:52.341963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:52.342066 (+ 103us) server_negotiation.cc:407] Connection header received
0929 06:36:52.342150 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:52.342151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:52.342191 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:52.342276 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:36:52.342377 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.342881 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.343646 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.343864 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.343989 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.344146 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:36:52.344197 (+ 51us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0929 06:36:52.344476 (+ 279us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38254: token expired
Metrics: {"server-negotiator.queue_time_us":49}
W20260929 06:36:52.344679 25813 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38254: token expired
W20260929 06:36:52.344981 25280 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.61.126:32981)
I20260929 06:36:52.353513 25813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.345303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38268 (local address 127.9.61.126:32981)
0929 06:36:52.345338 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:52.345341 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:52.345367 (+ 26us) server_negotiation.cc:407] Connection header received
0929 06:36:52.345450 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:52.345451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:52.345460 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:52.345536 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:36:52.346214 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.347029 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.348212 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.348729 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.348843 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.350579 (+ 1736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:36:52.350581 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:36:52.350581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:36:52.350588 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:36:52.352263 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:52.352703 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:52.352704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:52.352704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:52.352783 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:36:52.352995 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:36:52.352995 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:36:52.352996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:36:52.353115 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:36:52.353222 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:52.353328 (+ 106us) server_negotiation.cc:299] Negotiation successful
0929 06:36:52.353406 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:36:52.354907 25351 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:36:52.357164 25351 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:36:52.359696 25473 tablet_service.cc:1467] Processing CreateTablet for tablet 93b5266812d24329a4fceafa5cbc3e9b (DEFAULT_TABLE table=test-table [id=ce2f907c8ef54445b2fed158f29397d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:52.359925 25473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93b5266812d24329a4fceafa5cbc3e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:52.361328 25431 tablet_bootstrap.cc:492] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508: Bootstrap starting.
I20260929 06:36:52.361649 25431 tablet_bootstrap.cc:654] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:52.362442 25431 tablet_bootstrap.cc:492] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508: No bootstrap required, opened a new log
I20260929 06:36:52.362499 25431 ts_tablet_manager.cc:1397] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260929 06:36:52.362669 25431 raft_consensus.cc:348] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:36:52.362746 25431 raft_consensus.cc:374] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:52.362777 25431 raft_consensus.cc:729] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599e7d6e22b945b0b5b26ff37bc12508, State: Initialized, Role: FOLLOWER
I20260929 06:36:52.362851 25431 consensus_queue.cc:260] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:36:52.362933 25431 ts_tablet_manager.cc:1428] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260929 06:36:52.364583 25817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.359557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40912 (local address 127.9.61.67:38513)
0929 06:36:52.359904 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:52.359909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:52.359919 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:36:52.359978 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:52.359981 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:52.359997 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:52.360118 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:52.360245 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.361287 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.363332 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.364166 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.364251 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.364314 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:52.364456 (+ 142us) server_negotiation.cc:299] Negotiation successful
0929 06:36:52.364495 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":88,"threads_started":1}
I20260929 06:36:52.364588 25816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.359319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40538 (local address 127.9.61.66:33941)
0929 06:36:52.359483 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:52.359489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:52.359499 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:36:52.359541 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:52.359543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:52.359558 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:52.359704 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:52.359865 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.361212 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.363478 (+ 2266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.364191 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.364257 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.364314 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:52.364456 (+ 142us) server_negotiation.cc:299] Negotiation successful
0929 06:36:52.364495 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
I20260929 06:36:52.364585 25815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.359253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:38513 (local address 127.0.0.1:40912)
0929 06:36:52.359416 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:52.359426 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:52.359470 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:52.360123 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:52.360124 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:52.360126 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:52.360173 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.360174 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.361370 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.361371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.363246 (+ 1875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.363248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.364265 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.364266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.364341 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.364370 (+ 29us) client_negotiation.cc:769] Sending connection context
0929 06:36:52.364441 (+ 71us) client_negotiation.cc:240] Negotiation successful
0929 06:36:52.364486 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":930,"thread_start_us":105,"threads_started":1}
I20260929 06:36:52.364585 25546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.359210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:33941 (local address 127.0.0.1:40538)
0929 06:36:52.359264 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:52.359282 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:52.359327 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:52.359706 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:52.359707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:52.359709 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:52.359765 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.359767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.361315 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.361316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.362270 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.362273 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.364264 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.364265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.364346 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.364368 (+ 22us) client_negotiation.cc:769] Sending connection context
0929 06:36:52.364441 (+ 73us) client_negotiation.cc:240] Negotiation successful
0929 06:36:52.364486 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":2}
I20260929 06:36:52.365444 25743 tablet_service.cc:1467] Processing CreateTablet for tablet 93b5266812d24329a4fceafa5cbc3e9b (DEFAULT_TABLE table=test-table [id=ce2f907c8ef54445b2fed158f29397d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:52.365447 25611 tablet_service.cc:1467] Processing CreateTablet for tablet 93b5266812d24329a4fceafa5cbc3e9b (DEFAULT_TABLE table=test-table [id=ce2f907c8ef54445b2fed158f29397d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:36:52.365825 25611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93b5266812d24329a4fceafa5cbc3e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:52.365825 25743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93b5266812d24329a4fceafa5cbc3e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:36:52.369500 25819 tablet_bootstrap.cc:492] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878: Bootstrap starting.
I20260929 06:36:52.369500 25820 tablet_bootstrap.cc:492] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2: Bootstrap starting.
I20260929 06:36:52.370285 25819 tablet_bootstrap.cc:654] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:52.370285 25820 tablet_bootstrap.cc:654] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2: Neither blocks nor log segments found. Creating new log.
I20260929 06:36:52.370915 25819 log.cc:824] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:52.370929 25820 log.cc:824] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2: Log is configured to *not* fsync() on all Append() calls
I20260929 06:36:52.371832 25819 tablet_bootstrap.cc:492] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878: No bootstrap required, opened a new log
I20260929 06:36:52.371912 25819 ts_tablet_manager.cc:1397] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:36:52.372004 25820 tablet_bootstrap.cc:492] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2: No bootstrap required, opened a new log
I20260929 06:36:52.372072 25820 ts_tablet_manager.cc:1397] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:36:52.374049 25820 raft_consensus.cc:348] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:36:52.374049 25819 raft_consensus.cc:348] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:36:52.374260 25819 raft_consensus.cc:374] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:52.374260 25820 raft_consensus.cc:374] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:36:52.374301 25820 raft_consensus.cc:729] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d635b1b9cf5442bb0327f562b16c9c2, State: Initialized, Role: FOLLOWER
I20260929 06:36:52.374301 25819 raft_consensus.cc:729] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9516a5dacb4139b3513f1519d18878, State: Initialized, Role: FOLLOWER
I20260929 06:36:52.374429 25820 consensus_queue.cc:260] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:36:52.374429 25819 consensus_queue.cc:260] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:36:52.374747 25819 ts_tablet_manager.cc:1428] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:36:52.374747 25820 ts_tablet_manager.cc:1428] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:36:52.374779 25677 heartbeater.cc:503] Master 127.9.61.126:32981 was elected leader, sending a full tablet report...
I20260929 06:36:52.374912 25809 heartbeater.cc:503] Master 127.9.61.126:32981 was elected leader, sending a full tablet report...
W20260929 06:36:52.443675 25678 tablet.cc:2369] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:36:52.536458 25540 tablet.cc:2369] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:36:52.579162 25810 tablet.cc:2369] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:36:52.643882 25545 raft_consensus.cc:482] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:36:52.644027 25545 raft_consensus.cc:504] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:36:52.644426 25545 leader_election.cc:288] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941), fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513)
I20260929 06:36:52.647434 25816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.644677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:57035 (local address 127.9.61.66:33941)
0929 06:36:52.644724 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:52.644725 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:52.644877 (+ 152us) server_negotiation.cc:407] Connection header received
0929 06:36:52.644977 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:52.644978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:52.644991 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:52.645062 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:52.645216 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.645675 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.646674 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.647057 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.647153 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.647163 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:52.647317 (+ 154us) server_negotiation.cc:299] Negotiation successful
0929 06:36:52.647354 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:36:52.647440 25817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.644729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:39647 (local address 127.9.61.67:38513)
0929 06:36:52.644772 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:52.644774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:52.644972 (+ 198us) server_negotiation.cc:407] Connection header received
0929 06:36:52.645045 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:52.645046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:52.645057 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:52.645102 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:36:52.645244 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.645684 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.646684 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.647072 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.647164 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.647188 (+ 24us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:52.647335 (+ 147us) server_negotiation.cc:299] Negotiation successful
0929 06:36:52.647370 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:36:52.647464 25825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.644597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:38513 (local address 127.9.61.65:39647)
0929 06:36:52.644900 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:52.644908 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:52.644981 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:52.645104 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:52.645105 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:52.645107 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:52.645167 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.645169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.645771 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.645772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.646574 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.646576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.647166 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.647167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.647234 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.647259 (+ 25us) client_negotiation.cc:769] Sending connection context
0929 06:36:52.647330 (+ 71us) client_negotiation.cc:240] Negotiation successful
0929 06:36:52.647372 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":1,"thread_start_us":121,"threads_started":1}
I20260929 06:36:52.647477 25826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.644592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:33941 (local address 127.9.61.65:57035)
0929 06:36:52.644773 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:52.644783 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:36:52.644885 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:36:52.645079 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:36:52.645080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:36:52.645083 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:36:52.645143 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.645145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.645764 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.645765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.646576 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:36:52.646578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.647155 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.647156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:36:52.647219 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.647242 (+ 23us) client_negotiation.cc:769] Sending connection context
0929 06:36:52.647312 (+ 70us) client_negotiation.cc:240] Negotiation successful
0929 06:36:52.647354 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":51,"thread_start_us":122,"threads_started":1}
I20260929 06:36:52.647750 25763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93b5266812d24329a4fceafa5cbc3e9b" candidate_uuid: "599e7d6e22b945b0b5b26ff37bc12508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9516a5dacb4139b3513f1519d18878" is_pre_election: true
I20260929 06:36:52.647917 25763 raft_consensus.cc:2454] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599e7d6e22b945b0b5b26ff37bc12508 in term 0.
I20260929 06:36:52.647994 25631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93b5266812d24329a4fceafa5cbc3e9b" candidate_uuid: "599e7d6e22b945b0b5b26ff37bc12508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" is_pre_election: true
I20260929 06:36:52.648142 25631 raft_consensus.cc:2454] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599e7d6e22b945b0b5b26ff37bc12508 in term 0.
I20260929 06:36:52.648204 25428 leader_election.cc:302] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599e7d6e22b945b0b5b26ff37bc12508, fe9516a5dacb4139b3513f1519d18878; no voters:
I20260929 06:36:52.648355 25545 raft_consensus.cc:2781] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:36:52.648418 25545 raft_consensus.cc:482] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:36:52.648435 25545 raft_consensus.cc:3037] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:52.649124 25545 raft_consensus.cc:504] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:36:52.649284 25545 leader_election.cc:288] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 1 election: Requested vote from peers 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941), fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513)
I20260929 06:36:52.649457 25631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93b5266812d24329a4fceafa5cbc3e9b" candidate_uuid: "599e7d6e22b945b0b5b26ff37bc12508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d635b1b9cf5442bb0327f562b16c9c2"
I20260929 06:36:52.649451 25763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93b5266812d24329a4fceafa5cbc3e9b" candidate_uuid: "599e7d6e22b945b0b5b26ff37bc12508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9516a5dacb4139b3513f1519d18878"
I20260929 06:36:52.649554 25631 raft_consensus.cc:3037] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:52.649549 25763 raft_consensus.cc:3037] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:36:52.650236 25631 raft_consensus.cc:2454] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599e7d6e22b945b0b5b26ff37bc12508 in term 1.
I20260929 06:36:52.650305 25763 raft_consensus.cc:2454] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599e7d6e22b945b0b5b26ff37bc12508 in term 1.
I20260929 06:36:52.650444 25427 leader_election.cc:302] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599e7d6e22b945b0b5b26ff37bc12508, 5d635b1b9cf5442bb0327f562b16c9c2; no voters:
I20260929 06:36:52.650525 25545 raft_consensus.cc:2781] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:36:52.650633 25545 raft_consensus.cc:686] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 LEADER]: Becoming Leader. State: Replica: 599e7d6e22b945b0b5b26ff37bc12508, State: Running, Role: LEADER
I20260929 06:36:52.650702 25545 consensus_queue.cc:237] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:36:52.651409 25350 catalog_manager.cc:5495] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 599e7d6e22b945b0b5b26ff37bc12508 (127.9.61.65). New cstate: current_term: 1 leader_uuid: "599e7d6e22b945b0b5b26ff37bc12508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } health_report { overall_health: HEALTHY } } }
I20260929 06:36:52.718044 25829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.715413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37446 (local address 127.9.61.65:37129)
0929 06:36:52.715604 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0929 06:36:52.715606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:36:52.715613 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:36:52.715682 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:36:52.715683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:36:52.715702 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:36:52.715822 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:36:52.715978 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.716466 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.717221 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:36:52.717425 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:36:52.717504 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:36:52.717672 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:36:52.717779 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:36:52.717870 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 06:36:52.717911 (+ 41us) server_negotiation.cc:299] Negotiation successful
0929 06:36:52.717931 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":104,"threads_started":1}
I20260929 06:36:52.719772 25763 raft_consensus.cc:1261] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878 [term 1 FOLLOWER]: Refusing update from remote peer 599e7d6e22b945b0b5b26ff37bc12508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:36:52.719779 25631 raft_consensus.cc:1261] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2 [term 1 FOLLOWER]: Refusing update from remote peer 599e7d6e22b945b0b5b26ff37bc12508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:36:52.720149 25827 consensus_queue.cc:1035] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:36:52.720291 25545 consensus_queue.cc:1035] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:36:52.722667 25830 mvcc.cc:205] Tried to move back new op lower bound from 7334558976897150976 to 7334558976617947136. Current Snapshot: MvccSnapshot[applied={T|T < 7334558976897150976}]
I20260929 06:36:52.722819 25831 mvcc.cc:205] Tried to move back new op lower bound from 7334558976897150976 to 7334558976617947136. Current Snapshot: MvccSnapshot[applied={T|T < 7334558976897150976}]
I20260929 06:36:52.722944 25832 mvcc.cc:205] Tried to move back new op lower bound from 7334558976897150976 to 7334558976617947136. Current Snapshot: MvccSnapshot[applied={T|T < 7334558976897150976}]
I20260929 06:36:52.725026 25350 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:36:52.725111 25350 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:36:52.725879 25350 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Sending DeleteTablet for 3 replicas of tablet 93b5266812d24329a4fceafa5cbc3e9b
I20260929 06:36:52.726241 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 25389
I20260929 06:36:52.726240 25743 tablet_service.cc:1514] Processing DeleteTablet for tablet 93b5266812d24329a4fceafa5cbc3e9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:52 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:40912
I20260929 06:36:52.726243 25611 tablet_service.cc:1514] Processing DeleteTablet for tablet 93b5266812d24329a4fceafa5cbc3e9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:36:52 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:40538
I20260929 06:36:52.727152 25840 tablet_replica.cc:330] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878: stopping tablet replica
I20260929 06:36:52.727260 25840 raft_consensus.cc:2229] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:36:52.727371 25840 raft_consensus.cc:2258] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:36:52.727519 25841 tablet_replica.cc:330] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2: stopping tablet replica
I20260929 06:36:52.727618 25841 raft_consensus.cc:2229] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:36:52.727727 25841 raft_consensus.cc:2258] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:36:52.727999 25840 ts_tablet_manager.cc:1905] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:36:52.728200 25841 ts_tablet_manager.cc:1905] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:36:52.729768 25841 ts_tablet_manager.cc:1918] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:36:52.729828 25841 log.cc:1196] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/93b5266812d24329a4fceafa5cbc3e9b
I20260929 06:36:52.730026 25841 ts_tablet_manager.cc:1939] T 93b5266812d24329a4fceafa5cbc3e9b P 5d635b1b9cf5442bb0327f562b16c9c2: Deleting consensus metadata
I20260929 06:36:52.730223 25840 ts_tablet_manager.cc:1918] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:36:52.730357 25840 log.cc:1196] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/93b5266812d24329a4fceafa5cbc3e9b
I20260929 06:36:52.730396 25337 catalog_manager.cc:4841] TS 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941): tablet 93b5266812d24329a4fceafa5cbc3e9b (table test-table [id=ce2f907c8ef54445b2fed158f29397d7]) successfully deleted
I20260929 06:36:52.730721 25840 ts_tablet_manager.cc:1939] T 93b5266812d24329a4fceafa5cbc3e9b P fe9516a5dacb4139b3513f1519d18878: Deleting consensus metadata
I20260929 06:36:52.731118 25338 catalog_manager.cc:4841] TS fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513): tablet 93b5266812d24329a4fceafa5cbc3e9b (table test-table [id=ce2f907c8ef54445b2fed158f29397d7]) successfully deleted
W20260929 06:36:52.732112 25338 connection.cc:535] client connection to 127.9.61.65:37129 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260929 06:36:52.732236 25338 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 06:36:52.732583 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 25544
I20260929 06:36:52.732695 25546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:36:52.732552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:37129 (local address 127.0.0.1:37450)
0929 06:36:52.732595 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0929 06:36:52.732631 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260929 06:36:52.733556 25338 catalog_manager.cc:4584] TS 599e7d6e22b945b0b5b26ff37bc12508 (127.9.61.65:37129): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 93b5266812d24329a4fceafa5cbc3e9b: Network error: Client connection negotiation failed: client connection to 127.9.61.65:37129: connect: Connection refused (error 111)
I20260929 06:36:52.737593 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 25680
I20260929 06:36:52.742570 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 25318
I20260929 06:37:12.748284 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:32981
--webserver_interface=127.9.61.126
--webserver_port=39595
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:32981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:12.828794 25843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:12.829083 25843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:12.829123 25843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:12.830276 25843 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260929 06:37:12.830344 25843 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260929 06:37:12.830365 25843 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260929 06:37:12.830384 25843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:12.830417 25843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:12.830447 25843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:12.830476 25843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:12.830507 25843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:12.832021 25843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:32981
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:32981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=39595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:12.832297 25843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:12.832523 25843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:37:12.837479 25843 server_base.cc:1034] running on GCE node
W20260929 06:37:12.837579 25851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:12.837603 25849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:12.837486 25848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:12.838146 25843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:12.838501 25843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:12.839681 25843 hybrid_clock.cc:648] HybridClock initialized: now 1790663832839648 us; error 51 us; skew 500 ppm
Sep 29 06:37:12 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663832, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:12.842072 25843 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:37:12.842555 25843 webserver.cc:460] Webserver started at http://127.9.61.126:39595/ using document root <none> and password file <none>
I20260929 06:37:12.842787 25843 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:12.842856 25843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:12.844183 25843 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:12.844911 25858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:12.845108 25843 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:12.845198 25843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "c86df3246b124a88bbec6806a99d7f50"
format_stamp: "Formatted at 2026-09-29 06:36:30 on dist-test-slave-601b"
server_key: "2bf9853f023bc3a7401072b184ca1f54"
server_key_iv: "ffa28177acfeb79f469bf5293b902eb5"
server_key_version: "encryptionkey@0"
I20260929 06:37:12.845523 25843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:12.855890 25843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:12.857681 25843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:12.857789 25843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:12.861603 25843 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:32981
I20260929 06:37:12.861912 25910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:32981 every 8 connection(s)
I20260929 06:37:12.862051 25843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:12.863371 25911 sys_catalog.cc:263] Verifying existing consensus state
I20260929 06:37:12.863392 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 25843
I20260929 06:37:12.863696 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:37129
--local_ip_for_outbound_sockets=127.9.61.65
--tserver_master_addrs=127.9.61.126:32981
--webserver_port=38017
--webserver_interface=127.9.61.65
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:37:12.864419 25911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Bootstrap starting.
I20260929 06:37:12.872973 25911 log.cc:824] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:12.875283 25911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:37:12.875617 25911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Bootstrap complete.
I20260929 06:37:12.877988 25911 raft_consensus.cc:348] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } }
I20260929 06:37:12.878204 25911 raft_consensus.cc:729] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c86df3246b124a88bbec6806a99d7f50, State: Initialized, Role: FOLLOWER
I20260929 06:37:12.878365 25911 consensus_queue.cc:260] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } }
I20260929 06:37:12.878429 25911 raft_consensus.cc:388] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:12.878471 25911 raft_consensus.cc:482] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:12.878522 25911 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 2 FOLLOWER]: Advancing to term 3
I20260929 06:37:12.879535 25911 raft_consensus.cc:504] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } }
I20260929 06:37:12.879621 25911 leader_election.cc:302] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c86df3246b124a88bbec6806a99d7f50; no voters:
I20260929 06:37:12.879851 25911 leader_election.cc:288] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260929 06:37:12.879886 25915 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 06:37:12.880033 25915 raft_consensus.cc:686] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [term 3 LEADER]: Becoming Leader. State: Replica: c86df3246b124a88bbec6806a99d7f50, State: Running, Role: LEADER
I20260929 06:37:12.880124 25915 consensus_queue.cc:237] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } }
I20260929 06:37:12.880160 25911 sys_catalog.cc:564] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:12.880386 25916 sys_catalog.cc:455] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c86df3246b124a88bbec6806a99d7f50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } } }
I20260929 06:37:12.880472 25916 sys_catalog.cc:458] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:12.880721 25917 sys_catalog.cc:455] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c86df3246b124a88bbec6806a99d7f50. Latest consensus state: current_term: 3 leader_uuid: "c86df3246b124a88bbec6806a99d7f50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c86df3246b124a88bbec6806a99d7f50" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32981 } } }
I20260929 06:37:12.880853 25917 sys_catalog.cc:458] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:12.880941 25920 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:12.881783 25920 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:12.881903 25920 catalog_manager.cc:1259] Loaded cluster ID: f5a3c5b522294c5fb0a27fcecacea377
I20260929 06:37:12.882139 25920 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:12.882958 25920 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:12.883142 25920 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Loaded TSK: 0
I20260929 06:37:12.883199 25920 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c86df3246b124a88bbec6806a99d7f50: Loaded TSK: 1
F20260929 06:37:12.883414 25920 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f1b01f0c9ad google::LogMessage::Fail() at ??:0
@ 0x7f1b01f0f88a google::LogMessage::SendToLog() at ??:0
@ 0x7f1b01f0c4de google::LogMessage::Flush() at ??:0
@ 0x7f1b01f0da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f1b04679104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f1b04676d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f1b09e661cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f1b09e6648e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f1b09e66594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f1b09e2cc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f1b09e36ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f1b03dda0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f1b03dcf954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1b04c336db start_thread at ??:0
@ 0x7f1b00a0a61f clone at ??:0
W20260929 06:37:12.964782 25913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:12.964988 25913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:12.965013 25913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:12.966161 25913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:12.966204 25913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:12.966231 25913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:37:12.967690 25913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:37129
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=38017
--tserver_master_addrs=127.9.61.126:32981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:12.967935 25913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:12.968210 25913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:12.973090 25952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:12.973156 25953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:12.973348 25955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:12.973456 25913 server_base.cc:1034] running on GCE node
I20260929 06:37:12.973703 25913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:12.973958 25913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:12.975106 25913 hybrid_clock.cc:648] HybridClock initialized: now 1790663832975090 us; error 34 us; skew 500 ppm
Sep 29 06:37:12 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663832, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:12.977802 25913 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:37:12.978307 25913 webserver.cc:460] Webserver started at http://127.9.61.65:38017/ using document root <none> and password file <none>
I20260929 06:37:12.978595 25913 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:12.978665 25913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:12.980119 25913 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:12.980975 25962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:12.981179 25913 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:12.981281 25913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "599e7d6e22b945b0b5b26ff37bc12508"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "69a20d3300c4e0aa9cfaf97bbb6df1c8"
server_key_iv: "2138aa8118ac1dd0f36f0e37f515a3e8"
server_key_version: "encryptionkey@0"
I20260929 06:37:12.981655 25913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:12.993407 25913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:12.995657 25913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:12.995815 25913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:12.996097 25913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:12.996526 25969 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260929 06:37:12.998466 25913 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260929 06:37:12.998528 25913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260929 06:37:12.998572 25913 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260929 06:37:12.999235 25913 ts_tablet_manager.cc:610] Registered 1 tablets
I20260929 06:37:12.999292 25913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260929 06:37:12.999374 25969 tablet_bootstrap.cc:492] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508: Bootstrap starting.
I20260929 06:37:13.006474 25913 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:37129
I20260929 06:37:13.006632 26076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:37129 every 8 connection(s)
I20260929 06:37:13.006899 25913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:37:13.008980 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 25913
I20260929 06:37:13.009302 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:33941
--local_ip_for_outbound_sockets=127.9.61.66
--tserver_master_addrs=127.9.61.126:32981
--webserver_port=41317
--webserver_interface=127.9.61.66
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:37:13.010246 25969 log.cc:824] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:13.013025 25969 tablet_bootstrap.cc:492] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 06:37:13.013345 25969 tablet_bootstrap.cc:492] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508: Bootstrap complete.
I20260929 06:37:13.014539 25969 ts_tablet_manager.cc:1397] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.009s
I20260929 06:37:13.015970 25969 raft_consensus.cc:348] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:37:13.016304 25969 raft_consensus.cc:729] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599e7d6e22b945b0b5b26ff37bc12508, State: Initialized, Role: FOLLOWER
I20260929 06:37:13.016476 25969 consensus_queue.cc:260] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:37:13.016752 25969 ts_tablet_manager.cc:1428] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260929 06:37:13.075634 26079 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:37:13.007608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:55575)
0929 06:37:13.007777 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:13.007822 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:13.008352 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:13.075426 (+ 67074us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
W20260929 06:37:13.075898 26077 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:32981 (0 consecutive failures): Network error: Failed to ping master at 127.9.61.126:32981: Client connection negotiation failed: client connection to 127.9.61.126:32981: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260929 06:37:13.076323 26079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:13.076202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:59455)
0929 06:37:13.076255 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:13.076294 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 06:37:13.076651 26079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:13.076558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:39557)
0929 06:37:13.076607 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:13.076631 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260929 06:37:13.076766 26077 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:37:13.096095 26080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:13.096290 26080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:13.096312 26080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:13.097463 26080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:13.097505 26080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:13.097556 26080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:37:13.098981 26080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:33941
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=41317
--tserver_master_addrs=127.9.61.126:32981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:13.099221 26080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:13.099437 26080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:13.104513 26088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:13.104696 26090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:13.104525 26087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:13.104784 26080 server_base.cc:1034] running on GCE node
I20260929 06:37:13.105068 26080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:13.105353 26080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:13.106539 26080 hybrid_clock.cc:648] HybridClock initialized: now 1790663833106518 us; error 37 us; skew 500 ppm
Sep 29 06:37:13 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663833, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:13.110000 26080 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:37:13.110466 26080 webserver.cc:460] Webserver started at http://127.9.61.66:41317/ using document root <none> and password file <none>
I20260929 06:37:13.110646 26080 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:13.110687 26080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:13.111999 26080 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:37:13.112632 26097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:13.112972 26080 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:37:13.113065 26080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "5d635b1b9cf5442bb0327f562b16c9c2"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "cbc95a7b68596296c5c08adfe02ddf34"
server_key_iv: "ef4746e7dd69237e4ab20df7f06aca0f"
server_key_version: "encryptionkey@0"
I20260929 06:37:13.113391 26080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:13.124716 26080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:13.126689 26080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:13.126802 26080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:13.127002 26080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:13.127243 26080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:13.127272 26080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:13.127293 26080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:13.127305 26080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:13.133344 26080 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:33941
I20260929 06:37:13.133409 26210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:33941 every 8 connection(s)
I20260929 06:37:13.133749 26080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:37:13.134928 26213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:13.134433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:49505)
0929 06:37:13.134590 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:13.134663 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":71,"threads_started":1}
I20260929 06:37:13.134930 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 26080
I20260929 06:37:13.135241 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:38513
--local_ip_for_outbound_sockets=127.9.61.67
--tserver_master_addrs=127.9.61.126:32981
--webserver_port=39737
--webserver_interface=127.9.61.67
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:43797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:13.135450 26211 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:32981 (0 consecutive failures): Network error: Failed to ping master at 127.9.61.126:32981: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
I20260929 06:37:13.135736 26213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:13.135641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:57425)
0929 06:37:13.135688 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:13.135716 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 06:37:13.136051 26213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:13.135983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:57771)
0929 06:37:13.136009 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:13.136038 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260929 06:37:13.136168 26211 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260929 06:37:13.214947 26214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:13.215167 26214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:13.215190 26214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:13.216434 26214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:13.216483 26214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:13.216511 26214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:37:13.217999 26214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:38513
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=39737
--tserver_master_addrs=127.9.61.126:32981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:13.218238 26214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:13.218463 26214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:13.223460 26220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:13.223511 26222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:13.223461 26219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:13.223759 26214 server_base.cc:1034] running on GCE node
I20260929 06:37:13.224030 26214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:13.224334 26214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:13.225523 26214 hybrid_clock.cc:648] HybridClock initialized: now 1790663833225508 us; error 25 us; skew 500 ppm
Sep 29 06:37:13 dist-test-slave-601b krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663833, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:13.228139 26214 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:37:13.228610 26214 webserver.cc:460] Webserver started at http://127.9.61.67:39737/ using document root <none> and password file <none>
I20260929 06:37:13.228883 26214 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:13.228981 26214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:13.230394 26214 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:37:13.231027 26229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:13.231217 26214 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:37:13.231314 26214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "fe9516a5dacb4139b3513f1519d18878"
format_stamp: "Formatted at 2026-09-29 06:36:31 on dist-test-slave-601b"
server_key: "bda1ba171273bb7be2ee8e827fd3c4b0"
server_key_iv: "d20118929d3167ac10e99d2ca8d3aadf"
server_key_version: "encryptionkey@0"
I20260929 06:37:13.231710 26214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:13.261437 26214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:13.263453 26214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:13.263633 26214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:13.263901 26214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:13.264250 26214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:13.264312 26214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:13.264389 26214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:13.264423 26214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:13.270675 26214 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:38513
I20260929 06:37:13.270731 26342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:38513 every 8 connection(s)
I20260929 06:37:13.271106 26214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:37:13.272219 26345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:13.271792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:36409)
0929 06:37:13.271993 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:13.272075 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":80,"threads_started":1}
W20260929 06:37:13.272653 26343 heartbeater.cc:644] Failed to heartbeat to 127.9.61.126:32981 (0 consecutive failures): Network error: Failed to ping master at 127.9.61.126:32981: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
I20260929 06:37:13.272975 26345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:13.272887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:46331)
0929 06:37:13.272932 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:13.272958 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 06:37:13.273231 26345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:13.273184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:54255)
0929 06:37:13.273203 (+ 19us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:13.273219 (+ 16us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260929 06:37:13.273419 26343 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260929 06:37:13.280779 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 26214
I20260929 06:37:14.077395 26347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:14.077131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:57419)
0929 06:37:14.077288 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:14.077333 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":109,"threads_started":1}
I20260929 06:37:14.136649 26348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:14.136456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:54937)
0929 06:37:14.136567 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:14.136598 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":57,"threads_started":1}
I20260929 06:37:14.273947 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:14.273704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:43285)
0929 06:37:14.273856 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:14.273894 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":69,"threads_started":1}
I20260929 06:37:14.440016 26350 raft_consensus.cc:482] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:37:14.440140 26350 raft_consensus.cc:504] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:37:14.440474 26350 leader_election.cc:288] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941), fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513)
Sep 29 06:37:14 dist-test-slave-601b krb5kdc[24772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663832, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.66@KRBTEST.COM
Sep 29 06:37:14 dist-test-slave-601b krb5kdc[24772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663832, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.67@KRBTEST.COM
I20260929 06:37:14.451436 26352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:14.440773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:43465 (local address 127.9.61.66:33941)
0929 06:37:14.440971 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:14.440978 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:14.441011 (+ 33us) server_negotiation.cc:407] Connection header received
0929 06:37:14.441594 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:14.441597 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:14.441657 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:14.441815 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:14.442769 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:14.443606 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:14.444687 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:14.445100 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:14.445223 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:14.447626 (+ 2403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:14.447630 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:14.447631 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:14.447642 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:14.449690 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:14.450213 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:14.450216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:14.450216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:14.450311 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:14.450577 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:14.450578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:14.450578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:14.450829 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:14.450920 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:14.451191 (+ 271us) server_negotiation.cc:299] Negotiation successful
0929 06:37:14.451319 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":75,"threads_started":1}
I20260929 06:37:14.451470 26347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:14.440639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:33941 (local address 127.9.61.65:43465)
0929 06:37:14.440723 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:14.440735 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:14.440851 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:14.441890 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:14.441893 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:14.442395 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:14.442599 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:14.442605 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:14.443727 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:14.443728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:14.444593 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:14.444595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:14.445196 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:14.445197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:14.445305 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:14.445914 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:37:14.445922 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:14.447502 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:14.449805 (+ 2303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:14.449812 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:14.449815 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:14.450110 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:14.450392 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:14.450393 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:14.450393 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:14.450508 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:14.450913 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:14.450914 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:14.451029 (+ 115us) client_negotiation.cc:769] Sending connection context
0929 06:37:14.451134 (+ 105us) client_negotiation.cc:240] Negotiation successful
0929 06:37:14.451340 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"mutex_wait_us":4}
I20260929 06:37:14.451609 26351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:14.440697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:38513 (local address 127.9.61.65:33911)
0929 06:37:14.440821 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:14.440833 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:14.440887 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:14.441945 (+ 1058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:14.441947 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:14.442394 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:14.442599 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:14.442605 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:14.443718 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:14.443719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:14.444595 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:14.444597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:14.445201 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:14.445202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:14.445306 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:14.445972 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:37:14.445976 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:14.447895 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:14.449866 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:14.449867 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:14.449867 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:14.450112 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:14.450382 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:14.450383 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:14.450384 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:14.450502 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:14.450891 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:14.450897 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:14.451029 (+ 132us) client_negotiation.cc:769] Sending connection context
0929 06:37:14.451133 (+ 104us) client_negotiation.cc:240] Negotiation successful
0929 06:37:14.451424 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":201,"thread_start_us":51,"threads_started":1}
I20260929 06:37:14.452173 26353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:14.440805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:33911 (local address 127.9.61.67:38513)
0929 06:37:14.440964 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:14.440978 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:14.441011 (+ 33us) server_negotiation.cc:407] Connection header received
0929 06:37:14.441594 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:14.441597 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:14.441657 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:14.441815 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:14.442730 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:14.443605 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:14.444699 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:14.445100 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:14.445231 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:14.448086 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:14.448089 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:14.448090 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:14.448099 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:14.449762 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:14.450211 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:14.450214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:14.450214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:14.450309 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:14.450578 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:14.450579 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:14.450579 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:14.450817 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:14.450910 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:14.451200 (+ 290us) server_negotiation.cc:299] Negotiation successful
0929 06:37:14.451325 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":53,"threads_started":1}
W20260929 06:37:14.452453 25965 leader_election.cc:341] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941): Not found: Tablet not found: 93b5266812d24329a4fceafa5cbc3e9b
W20260929 06:37:14.452945 25966 leader_election.cc:341] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513): Not found: Tablet not found: 93b5266812d24329a4fceafa5cbc3e9b
I20260929 06:37:14.453003 25966 leader_election.cc:302] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599e7d6e22b945b0b5b26ff37bc12508; no voters: 5d635b1b9cf5442bb0327f562b16c9c2, fe9516a5dacb4139b3513f1519d18878
I20260929 06:37:14.453138 26350 raft_consensus.cc:2726] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:37:15.078241 26354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:15.077991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:60313)
0929 06:37:15.078144 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:15.078191 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":70,"threads_started":1}
I20260929 06:37:15.137352 26355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:15.137140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:58099)
0929 06:37:15.137264 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:15.137307 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":62,"threads_started":1}
I20260929 06:37:15.274684 26356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:15.274451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:41375)
0929 06:37:15.274593 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:15.274638 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
I20260929 06:37:16.000416 26357 raft_consensus.cc:482] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:37:16.000525 26357 raft_consensus.cc:504] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:37:16.000705 26357 leader_election.cc:288] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941), fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513)
W20260929 06:37:16.001104 25966 leader_election.cc:341] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513): Not found: Tablet not found: 93b5266812d24329a4fceafa5cbc3e9b
W20260929 06:37:16.001207 25965 leader_election.cc:341] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941): Not found: Tablet not found: 93b5266812d24329a4fceafa5cbc3e9b
I20260929 06:37:16.001292 25965 leader_election.cc:302] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599e7d6e22b945b0b5b26ff37bc12508; no voters: 5d635b1b9cf5442bb0327f562b16c9c2, fe9516a5dacb4139b3513f1519d18878
I20260929 06:37:16.001377 26357 raft_consensus.cc:2726] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:37:16.079020 26358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:16.078770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:39211)
0929 06:37:16.078929 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:16.078971 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":90,"threads_started":1}
I20260929 06:37:16.138041 26359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:16.137780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:46187)
0929 06:37:16.137925 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:16.137996 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":62,"threads_started":1}
I20260929 06:37:16.275490 26360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:16.275263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:54987)
0929 06:37:16.275413 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:16.275453 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":89,"threads_started":1}
I20260929 06:37:17.079852 26361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:17.079580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:33423)
0929 06:37:17.079745 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:17.079792 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":79,"threads_started":1}
I20260929 06:37:17.138888 26362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:17.138611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:38601)
0929 06:37:17.138789 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:17.138838 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":105,"threads_started":1}
I20260929 06:37:17.276361 26363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:17.276103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:36363)
0929 06:37:17.276257 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:17.276305 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":65,"threads_started":1}
I20260929 06:37:18.080703 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:18.080463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:36433)
0929 06:37:18.080607 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:18.080654 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":65,"threads_started":1}
I20260929 06:37:18.139694 26365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:18.139478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:59873)
0929 06:37:18.139601 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:18.139646 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":60,"threads_started":1}
I20260929 06:37:18.277168 26366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:18.276921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:38271)
0929 06:37:18.277075 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:18.277121 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":70,"threads_started":1}
I20260929 06:37:19.081472 26367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:19.081270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:39423)
0929 06:37:19.081394 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:19.081425 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":62,"threads_started":1}
I20260929 06:37:19.110163 26368 raft_consensus.cc:482] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:37:19.110255 26368 raft_consensus.cc:504] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:37:19.110456 26368 leader_election.cc:288] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941), fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513)
W20260929 06:37:19.110939 25966 leader_election.cc:341] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513): Not found: Tablet not found: 93b5266812d24329a4fceafa5cbc3e9b
W20260929 06:37:19.111027 25965 leader_election.cc:341] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941): Not found: Tablet not found: 93b5266812d24329a4fceafa5cbc3e9b
I20260929 06:37:19.111158 25965 leader_election.cc:302] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599e7d6e22b945b0b5b26ff37bc12508; no voters: 5d635b1b9cf5442bb0327f562b16c9c2, fe9516a5dacb4139b3513f1519d18878
I20260929 06:37:19.111250 26368 raft_consensus.cc:2726] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:37:19.140419 26369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:19.140212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:43245)
0929 06:37:19.140333 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:19.140373 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":58,"threads_started":1}
I20260929 06:37:19.277915 26370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:19.277686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:53917)
0929 06:37:19.277828 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:19.277867 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260929 06:37:20.082260 26371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:20.082009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:45847)
0929 06:37:20.082165 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:20.082210 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":71,"threads_started":1}
I20260929 06:37:20.141132 26372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:20.140910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:40509)
0929 06:37:20.141041 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:20.141085 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260929 06:37:20.278627 26373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:20.278371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:35073)
0929 06:37:20.278543 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:20.278583 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":80,"threads_started":1}
I20260929 06:37:21.083130 26374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:21.082885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:45931)
0929 06:37:21.083039 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:21.083083 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":83,"threads_started":1}
I20260929 06:37:21.142009 26375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:21.141779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:57583)
0929 06:37:21.141910 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:21.141966 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":58,"threads_started":1}
I20260929 06:37:21.279390 26376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:21.279152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:50301)
0929 06:37:21.279305 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:21.279349 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":76,"threads_started":1}
I20260929 06:37:22.083774 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:22.083557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:56681)
0929 06:37:22.083677 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:22.083711 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260929 06:37:22.142755 26378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:22.142519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:44427)
0929 06:37:22.142653 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:22.142707 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":62,"threads_started":1}
I20260929 06:37:22.280202 26379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:22.279930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:54133)
0929 06:37:22.280116 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:22.280158 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":115,"threads_started":1}
I20260929 06:37:23.084517 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:23.084267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:50609)
0929 06:37:23.084393 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:23.084437 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":73,"threads_started":1}
I20260929 06:37:23.143481 26381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:23.143264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:47341)
0929 06:37:23.143391 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:23.143432 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
I20260929 06:37:23.255858 26382 raft_consensus.cc:482] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:37:23.255997 26382 raft_consensus.cc:504] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d635b1b9cf5442bb0327f562b16c9c2" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 33941 } } peers { permanent_uuid: "fe9516a5dacb4139b3513f1519d18878" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38513 } } peers { permanent_uuid: "599e7d6e22b945b0b5b26ff37bc12508" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 37129 } }
I20260929 06:37:23.256166 26382 leader_election.cc:288] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941), fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513)
W20260929 06:37:23.256616 25965 leader_election.cc:341] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d635b1b9cf5442bb0327f562b16c9c2 (127.9.61.66:33941): Not found: Tablet not found: 93b5266812d24329a4fceafa5cbc3e9b
W20260929 06:37:23.256695 25966 leader_election.cc:341] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fe9516a5dacb4139b3513f1519d18878 (127.9.61.67:38513): Not found: Tablet not found: 93b5266812d24329a4fceafa5cbc3e9b
I20260929 06:37:23.256795 25966 leader_election.cc:302] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599e7d6e22b945b0b5b26ff37bc12508; no voters: 5d635b1b9cf5442bb0327f562b16c9c2, fe9516a5dacb4139b3513f1519d18878
I20260929 06:37:23.256878 26382 raft_consensus.cc:2726] T 93b5266812d24329a4fceafa5cbc3e9b P 599e7d6e22b945b0b5b26ff37bc12508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 06:37:23.280941 26383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:23.280691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:40589)
0929 06:37:23.280836 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:23.280879 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":64,"threads_started":1}
I20260929 06:37:24.085409 26384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:24.085193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:55053)
0929 06:37:24.085316 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:24.085363 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260929 06:37:24.144208 26385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:24.143993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:50985)
0929 06:37:24.144123 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:24.144159 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":61,"threads_started":1}
I20260929 06:37:24.281607 26386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:24.281375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:38245)
0929 06:37:24.281524 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:24.281561 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":62,"threads_started":1}
I20260929 06:37:25.086086 26387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:25.085867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:38591)
0929 06:37:25.085994 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:25.086037 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260929 06:37:25.144822 26388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:25.144629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:35207)
0929 06:37:25.144745 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:25.144779 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260929 06:37:25.282260 26389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:25.282060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:36397)
0929 06:37:25.282175 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:25.282212 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":59,"threads_started":1}
I20260929 06:37:26.086688 26390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:26.086490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:39469)
0929 06:37:26.086606 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:26.086643 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":58,"threads_started":1}
I20260929 06:37:26.145537 26391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:26.145309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:33951)
0929 06:37:26.145453 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:26.145492 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":57,"threads_started":1}
I20260929 06:37:26.283002 26392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:26.282779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:54787)
0929 06:37:26.282918 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:26.282959 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":94,"threads_started":1}
I20260929 06:37:27.087384 26393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:27.087171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:59107)
0929 06:37:27.087296 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:27.087336 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260929 06:37:27.146437 26394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:27.146152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:42685)
0929 06:37:27.146340 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:27.146383 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":79,"threads_started":1}
I20260929 06:37:27.284034 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:27.283707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:49391)
0929 06:37:27.283871 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:27.283908 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":73,"threads_started":1}
I20260929 06:37:28.088377 26396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:28.088137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.65:33167)
0929 06:37:28.088279 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:28.088323 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":63,"threads_started":1}
I20260929 06:37:28.147347 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:28.147066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.66:34379)
0929 06:37:28.147244 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:28.147300 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":78,"threads_started":1}
I20260929 06:37:28.284818 26398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:28.284620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32981 (local address 127.9.61.67:47481)
0929 06:37:28.284737 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:28.284774 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.126:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":58,"threads_started":1}
I20260929 06:37:28.291615 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 25913
I20260929 06:37:28.297175 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 26080
I20260929 06:37:28.301824 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 26214
2026-09-29T06:37:28Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58582 ms)
[----------] 30 tests from SecurityITest (227109 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:28 dist-test-slave-601b krb5kdc[26401](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:28 dist-test-slave-601b krb5kdc[26401](info): set up 2 sockets
Sep 29 06:37:28 dist-test-slave-601b krb5kdc[26401](info): commencing operation
krb5kdc: starting...
W20260929 06:37:29.335602 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:29 dist-test-slave-601b krb5kdc[26401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:37:29.453127 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:43653
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:42151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:43653
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:29.536883 26414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:29.537117 26414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:29.537155 26414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:29.538287 26414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:29.538365 26414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:29.538390 26414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:29.538420 26414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:29.538446 26414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:29.539920 26414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:42151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:43653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:43653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:29.540252 26414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:29.540483 26414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:29.545499 26419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:29.545528 26414 server_base.cc:1034] running on GCE node
W20260929 06:37:29.545545 26422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:29.545548 26420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:29.546016 26414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:29.546320 26414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:29.547528 26414 hybrid_clock.cc:648] HybridClock initialized: now 1790663849547509 us; error 29 us; skew 500 ppm
Sep 29 06:37:29 dist-test-slave-601b krb5kdc[26401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663849, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:29.550009 26414 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:37:29.550454 26414 webserver.cc:460] Webserver started at http://127.9.61.126:33481/ using document root <none> and password file <none>
I20260929 06:37:29.550630 26414 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:29.550670 26414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:29.550755 26414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:29.551744 26414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "dd553e15c63e4e799d894f246bbf7416"
format_stamp: "Formatted at 2026-09-29 06:37:29 on dist-test-slave-601b"
server_key: "6e8be38a003905f6f936aee3bf30d79a"
server_key_iv: "a10a993fa2d207e1c7a2742edea16cbf"
server_key_version: "encryptionkey@0"
I20260929 06:37:29.552143 26414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "dd553e15c63e4e799d894f246bbf7416"
format_stamp: "Formatted at 2026-09-29 06:37:29 on dist-test-slave-601b"
server_key: "6e8be38a003905f6f936aee3bf30d79a"
server_key_iv: "a10a993fa2d207e1c7a2742edea16cbf"
server_key_version: "encryptionkey@0"
I20260929 06:37:29.553387 26414 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:37:29.554072 26429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:29.554237 26414 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:37:29.554322 26414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "dd553e15c63e4e799d894f246bbf7416"
format_stamp: "Formatted at 2026-09-29 06:37:29 on dist-test-slave-601b"
server_key: "6e8be38a003905f6f936aee3bf30d79a"
server_key_iv: "a10a993fa2d207e1c7a2742edea16cbf"
server_key_version: "encryptionkey@0"
I20260929 06:37:29.554399 26414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:29.568074 26414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:29.569890 26414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:29.570041 26414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:29.574644 26414 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:43653
I20260929 06:37:29.574687 26481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:43653 every 8 connection(s)
I20260929 06:37:29.575038 26414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:29.576049 26482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:29.577708 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 26414
I20260929 06:37:29.577807 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:29.577996 9461 external_mini_cluster.cc:1428] Setting key 44a1c9a02a132fdcd31c84c9951afdb0
I20260929 06:37:29.578929 26482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416: Bootstrap starting.
I20260929 06:37:29.579610 26482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:29.579909 26482 log.cc:824] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:29.580724 26482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416: No bootstrap required, opened a new log
I20260929 06:37:29.583194 26482 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd553e15c63e4e799d894f246bbf7416" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43653 } }
I20260929 06:37:29.583367 26482 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:29.583415 26482 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd553e15c63e4e799d894f246bbf7416, State: Initialized, Role: FOLLOWER
I20260929 06:37:29.583537 26482 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd553e15c63e4e799d894f246bbf7416" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43653 } }
I20260929 06:37:29.583608 26482 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:29.583644 26482 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:29.583691 26482 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:29.584380 26482 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd553e15c63e4e799d894f246bbf7416" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43653 } }
I20260929 06:37:29.584501 26482 leader_election.cc:302] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd553e15c63e4e799d894f246bbf7416; no voters:
I20260929 06:37:29.584664 26482 leader_election.cc:288] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:29.584736 26487 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:29.584877 26487 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [term 1 LEADER]: Becoming Leader. State: Replica: dd553e15c63e4e799d894f246bbf7416, State: Running, Role: LEADER
I20260929 06:37:29.584950 26482 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:29.585016 26487 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd553e15c63e4e799d894f246bbf7416" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43653 } }
I20260929 06:37:29.585325 26487 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd553e15c63e4e799d894f246bbf7416. Latest consensus state: current_term: 1 leader_uuid: "dd553e15c63e4e799d894f246bbf7416" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd553e15c63e4e799d894f246bbf7416" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43653 } } }
I20260929 06:37:29.585409 26487 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:29.585335 26488 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd553e15c63e4e799d894f246bbf7416" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd553e15c63e4e799d894f246bbf7416" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43653 } } }
I20260929 06:37:29.585568 26488 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:29.585614 26493 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:29.586109 26493 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 29 06:37:29 dist-test-slave-601b krb5kdc[26401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:29.587419 26504 mvcc.cc:205] Tried to move back new op lower bound from 7334559127908532224 to 7334559127900573696. Current Snapshot: MvccSnapshot[applied={T|T < 7334559127908532224}]
I20260929 06:37:29.587814 26493 catalog_manager.cc:1347] Generated new cluster ID: 045d91fea2284aefaf2a8f54674be3e7
I20260929 06:37:29.587872 26493 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:29.595203 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:29.579134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42194 (local address 127.9.61.126:43653)
0929 06:37:29.579315 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:29.579325 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:29.579359 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:37:29.579934 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:29.579973 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:29.580038 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:29.580220 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:29.581054 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:29.582197 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:29.583323 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:29.583894 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:29.584049 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:29.586906 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:29.586909 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:29.586910 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:29.586921 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:29.593539 (+ 6618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:29.593923 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:29.593925 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:29.593926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:29.594018 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:29.594210 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:29.594210 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:29.594211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:29.594484 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:29.594600 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:29.594836 (+ 236us) server_negotiation.cc:299] Negotiation successful
0929 06:37:29.594967 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":79,"threads_started":1}
I20260929 06:37:29.597666 26493 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:29.598134 26493 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:29.606324 26493 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416: Generated new TSK 0
I20260929 06:37:29.606535 26493 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:37:29.638571 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:43653
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:42151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:29.739673 26508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:29.739913 26508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:29.739957 26508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:29.741169 26508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:29.741237 26508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:29.741283 26508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:37:29.742830 26508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:42151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:43653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:29.743108 26508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:29.743335 26508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:29.748200 26514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:29.748229 26513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:29.748359 26508 server_base.cc:1034] running on GCE node
W20260929 06:37:29.748200 26516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:29.748643 26508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:29.748857 26508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:29.749996 26508 hybrid_clock.cc:648] HybridClock initialized: now 1790663849749982 us; error 26 us; skew 500 ppm
Sep 29 06:37:29 dist-test-slave-601b krb5kdc[26401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663849, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:29.752554 26508 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:37:29.753006 26508 webserver.cc:460] Webserver started at http://127.9.61.65:34561/ using document root <none> and password file <none>
I20260929 06:37:29.753188 26508 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:29.753237 26508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:29.753320 26508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:29.754273 26508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "94977da486814397b8d713de33ca03b1"
format_stamp: "Formatted at 2026-09-29 06:37:29 on dist-test-slave-601b"
server_key: "acea3dd3fd35f6b302d72c9b6fa384f9"
server_key_iv: "1df91be0688745d58104ae5dd19d8bcc"
server_key_version: "encryptionkey@0"
I20260929 06:37:29.754581 26508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "94977da486814397b8d713de33ca03b1"
format_stamp: "Formatted at 2026-09-29 06:37:29 on dist-test-slave-601b"
server_key: "acea3dd3fd35f6b302d72c9b6fa384f9"
server_key_iv: "1df91be0688745d58104ae5dd19d8bcc"
server_key_version: "encryptionkey@0"
I20260929 06:37:29.755890 26508 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:37:29.756695 26523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:29.756876 26508 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:37:29.757033 26508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "94977da486814397b8d713de33ca03b1"
format_stamp: "Formatted at 2026-09-29 06:37:29 on dist-test-slave-601b"
server_key: "acea3dd3fd35f6b302d72c9b6fa384f9"
server_key_iv: "1df91be0688745d58104ae5dd19d8bcc"
server_key_version: "encryptionkey@0"
I20260929 06:37:29.757133 26508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:29.767550 26508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:29.769519 26508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:29.769677 26508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:29.769894 26508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:29.770202 26508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:29.770256 26508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:29.770296 26508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:29.770325 26508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:29.776539 26508 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:44011
I20260929 06:37:29.776594 26636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:44011 every 8 connection(s)
I20260929 06:37:29.776898 26508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:37:29 dist-test-slave-601b krb5kdc[26401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663849, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:29.784127 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 26508
I20260929 06:37:29.784255 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:37:29.784483 9461 external_mini_cluster.cc:1428] Setting key 86c017f9d71fdc9928fd06b14589aed3
I20260929 06:37:29.786060 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:29.777569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:58699 (local address 127.9.61.126:43653)
0929 06:37:29.777637 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:29.777639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:29.777806 (+ 167us) server_negotiation.cc:407] Connection header received
0929 06:37:29.778261 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:29.778262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:29.778271 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:29.778327 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:29.779225 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:29.779725 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:29.780710 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:29.780924 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:29.780986 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:29.783005 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:29.783006 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:29.783007 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:29.783013 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:29.784460 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:29.784954 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:29.784956 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:29.784956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:29.785019 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:29.785284 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:29.785285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:29.785286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:29.785405 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:29.785480 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:29.785877 (+ 397us) server_negotiation.cc:299] Negotiation successful
0929 06:37:29.785970 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:37:29.786212 26639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:29.777513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:43653 (local address 127.9.61.65:58699)
0929 06:37:29.777673 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:29.777713 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:29.778182 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:29.778381 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:29.778384 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:29.778944 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:29.779131 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:29.779136 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:29.779805 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:29.779805 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:29.780637 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:29.780639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:29.781000 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:29.781001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:29.781094 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:29.781535 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:37:29.781542 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:29.782911 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:29.784555 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:29.784562 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:29.784564 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:29.784876 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:29.785100 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:29.785101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:29.785101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:29.785215 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:29.785484 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:29.785491 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:29.785702 (+ 211us) client_negotiation.cc:769] Sending connection context
0929 06:37:29.785805 (+ 103us) client_negotiation.cc:240] Negotiation successful
0929 06:37:29.785971 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260929 06:37:29.786909 26637 heartbeater.cc:347] Connected to a master server at 127.9.61.126:43653
I20260929 06:37:29.786989 26637 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:29.787179 26637 heartbeater.cc:511] Master 127.9.61.126:43653 requested a full tablet report, sending...
I20260929 06:37:29.787778 26438 ts_manager.cc:194] Registered new tserver with Master: 94977da486814397b8d713de33ca03b1 (127.9.61.65:44011)
I20260929 06:37:29.788434 26438 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:58699
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:37:29.809270 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:43653
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:42151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:29.889799 26642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:29.890014 26642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:29.890038 26642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:29.891192 26642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:29.891234 26642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:29.891289 26642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:37:29.892772 26642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:42151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:43653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:29.893045 26642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:29.893277 26642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:29.898171 26650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:29.898244 26647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:29.898171 26648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:29.898358 26642 server_base.cc:1034] running on GCE node
I20260929 06:37:29.898639 26642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:29.898841 26642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:29.900017 26642 hybrid_clock.cc:648] HybridClock initialized: now 1790663849900003 us; error 26 us; skew 500 ppm
Sep 29 06:37:29 dist-test-slave-601b krb5kdc[26401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663849, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:29.902521 26642 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:37:29.903012 26642 webserver.cc:460] Webserver started at http://127.9.61.66:42851/ using document root <none> and password file <none>
I20260929 06:37:29.903249 26642 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:29.903334 26642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:29.903498 26642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:29.904665 26642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "059cbab9bd2242bd93569373a4024595"
format_stamp: "Formatted at 2026-09-29 06:37:29 on dist-test-slave-601b"
server_key: "5284e73756c90b5544df7213aa83e04a"
server_key_iv: "a5446d115cf346b5ea27613fb293694a"
server_key_version: "encryptionkey@0"
I20260929 06:37:29.905036 26642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "059cbab9bd2242bd93569373a4024595"
format_stamp: "Formatted at 2026-09-29 06:37:29 on dist-test-slave-601b"
server_key: "5284e73756c90b5544df7213aa83e04a"
server_key_iv: "a5446d115cf346b5ea27613fb293694a"
server_key_version: "encryptionkey@0"
I20260929 06:37:29.906380 26642 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:37:29.907157 26657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:29.907333 26642 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:37:29.907434 26642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "059cbab9bd2242bd93569373a4024595"
format_stamp: "Formatted at 2026-09-29 06:37:29 on dist-test-slave-601b"
server_key: "5284e73756c90b5544df7213aa83e04a"
server_key_iv: "a5446d115cf346b5ea27613fb293694a"
server_key_version: "encryptionkey@0"
I20260929 06:37:29.907518 26642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:29.925943 26642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:29.928032 26642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:29.928211 26642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:29.928463 26642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:29.928787 26642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:29.928844 26642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:29.928880 26642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:29.928932 26642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:29.934569 26642 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:34887
I20260929 06:37:29.934623 26770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:34887 every 8 connection(s)
I20260929 06:37:29.934934 26642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:37:29 dist-test-slave-601b krb5kdc[26401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663849, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:29.943991 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:29.935639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:39845 (local address 127.9.61.126:43653)
0929 06:37:29.935682 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:29.935684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:29.935894 (+ 210us) server_negotiation.cc:407] Connection header received
0929 06:37:29.936369 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:29.936371 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:29.936380 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:29.936431 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:29.937307 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:29.937784 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:29.938780 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:29.939007 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:29.939074 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:29.941135 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:29.941137 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:29.941137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:29.941145 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:29.942584 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:29.942993 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:29.942995 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:29.942995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:29.943058 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:29.943311 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:29.943312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:29.943313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:29.943429 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:29.943505 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:29.943782 (+ 277us) server_negotiation.cc:299] Negotiation successful
0929 06:37:29.943863 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:37:29.944154 26773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:29.935632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:43653 (local address 127.9.61.66:39845)
0929 06:37:29.935774 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:29.935806 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:29.936285 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:29.936484 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:29.936487 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:29.937037 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:29.937230 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:29.937234 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:29.937867 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:29.937867 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:29.938671 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:29.938673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:29.939088 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:29.939089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:29.939182 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:29.939637 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:37:29.939645 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:29.941021 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:29.942684 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:29.942691 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:29.942693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:29.942916 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:29.943125 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:29.943126 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:29.943126 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:29.943237 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:29.943497 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:29.943503 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:29.943644 (+ 141us) client_negotiation.cc:769] Sending connection context
0929 06:37:29.943747 (+ 103us) client_negotiation.cc:240] Negotiation successful
0929 06:37:29.943901 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":84,"threads_started":1}
I20260929 06:37:29.944186 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 26642
I20260929 06:37:29.944283 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:37:29.944491 9461 external_mini_cluster.cc:1428] Setting key 78aecd1d7ce3217f6ef5583980a9ca60
I20260929 06:37:29.944876 26771 heartbeater.cc:347] Connected to a master server at 127.9.61.126:43653
I20260929 06:37:29.944983 26771 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:29.945173 26771 heartbeater.cc:511] Master 127.9.61.126:43653 requested a full tablet report, sending...
I20260929 06:37:29.945523 26438 ts_manager.cc:194] Registered new tserver with Master: 059cbab9bd2242bd93569373a4024595 (127.9.61.66:34887)
I20260929 06:37:29.945904 26438 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:39845
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:37:29.968784 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:43653
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:42151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:30.052235 26776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:30.052459 26776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:30.052496 26776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:30.053635 26776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:30.053704 26776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:30.053746 26776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:37:30.055168 26776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:42151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:43653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:30.055444 26776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:30.055683 26776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:30.060724 26782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:30.060715 26784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:30.060817 26781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:30.061050 26776 server_base.cc:1034] running on GCE node
I20260929 06:37:30.061257 26776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:30.061484 26776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:30.062646 26776 hybrid_clock.cc:648] HybridClock initialized: now 1790663850062631 us; error 27 us; skew 500 ppm
Sep 29 06:37:30 dist-test-slave-601b krb5kdc[26401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663850, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:30.065287 26776 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:37:30.065773 26776 webserver.cc:460] Webserver started at http://127.9.61.67:33499/ using document root <none> and password file <none>
I20260929 06:37:30.066025 26776 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:30.066095 26776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:30.066242 26776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:30.067278 26776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "c7d74c507f2444e789a51b6d653e55c1"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "b1fa14b7ad5bafd3b171857b611fea39"
server_key_iv: "ec01c642a7853b96b05e3fc18cb8104c"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.067636 26776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "c7d74c507f2444e789a51b6d653e55c1"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "b1fa14b7ad5bafd3b171857b611fea39"
server_key_iv: "ec01c642a7853b96b05e3fc18cb8104c"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.069026 26776 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:37:30.069793 26791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.070013 26776 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:37:30.070122 26776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "c7d74c507f2444e789a51b6d653e55c1"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "b1fa14b7ad5bafd3b171857b611fea39"
server_key_iv: "ec01c642a7853b96b05e3fc18cb8104c"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.070204 26776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:30.095265 26776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:30.097738 26776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:30.097909 26776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:30.098160 26776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:30.098464 26776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:30.098517 26776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.098563 26776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:30.098594 26776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.104537 26776 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:42919
I20260929 06:37:30.104578 26904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:42919 every 8 connection(s)
I20260929 06:37:30.104938 26776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:37:30 dist-test-slave-601b krb5kdc[26401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663850, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:30.113622 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 26776
I20260929 06:37:30.113749 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:37:30.113907 9461 external_mini_cluster.cc:1428] Setting key 9bd03e9d877185f99b5baf514b35c013
I20260929 06:37:30.114455 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.105689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:40737 (local address 127.9.61.126:43653)
0929 06:37:30.105816 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.105818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.106011 (+ 193us) server_negotiation.cc:407] Connection header received
0929 06:37:30.106667 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.106669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.106681 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.106757 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:30.107745 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.108329 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.109337 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.109536 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.109621 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.111827 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:30.111828 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:30.111828 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:30.111834 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:30.113103 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:30.113474 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:30.113475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:30.113475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:30.113535 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:30.113801 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:30.113802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:30.113803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:30.113927 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:30.114021 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.114280 (+ 259us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.114367 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260929 06:37:30.114671 26907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.105657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:43653 (local address 127.9.61.67:40737)
0929 06:37:30.105873 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.105924 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.106552 (+ 628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.106833 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.106837 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.107439 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:30.107643 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.107649 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.108423 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.108424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.109230 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.109232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.109631 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.109632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.109752 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.110285 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:37:30.110298 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:30.111747 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:30.113173 (+ 1426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:30.113178 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:30.113180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:30.113387 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:30.113604 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:30.113605 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:30.113605 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:30.113698 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:30.114011 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:30.114017 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:30.114146 (+ 129us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.114257 (+ 111us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.114407 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":97,"threads_started":1}
I20260929 06:37:30.115049 26905 heartbeater.cc:347] Connected to a master server at 127.9.61.126:43653
I20260929 06:37:30.115131 26905 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:30.115324 26905 heartbeater.cc:511] Master 127.9.61.126:43653 requested a full tablet report, sending...
I20260929 06:37:30.115693 26438 ts_manager.cc:194] Registered new tserver with Master: c7d74c507f2444e789a51b6d653e55c1 (127.9.61.67:42919)
I20260929 06:37:30.116149 26438 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:40737
I20260929 06:37:30.125599 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:37:30.132695 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.126884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42206 (local address 127.9.61.126:43653)
0929 06:37:30.126955 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.126957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.127064 (+ 107us) server_negotiation.cc:407] Connection header received
0929 06:37:30.127131 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.127132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.127143 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.127199 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:30.127796 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.128349 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.129090 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.129295 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.129380 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.130449 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:30.130450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:30.130451 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:30.130458 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:30.131557 (+ 1099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:30.131894 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:30.131896 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:30.131896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:30.131979 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:30.132153 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:30.132154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:30.132155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:30.132301 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:30.132410 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.132518 (+ 108us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.132596 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 06:37:30.134161 26438 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42206:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:37:30.135725 26438 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:37:30.142223 26917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.138026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:42919 (local address 127.0.0.1:35966)
0929 06:37:30.138191 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.138240 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.138307 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.139077 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.139078 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.139080 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:30.139121 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.139122 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.140323 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.140324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.141223 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.141226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.141898 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.141899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.141984 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.141998 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.142099 (+ 101us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.142155 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":59,"threads_started":1}
I20260929 06:37:30.142364 26916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.138041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:34887 (local address 127.0.0.1:59508)
0929 06:37:30.138281 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.138291 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.138347 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.138688 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.138692 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.138695 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:30.138757 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.138758 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.140116 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.140117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.141245 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.141247 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.142148 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.142149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.142213 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.142217 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.142248 (+ 31us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.142288 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":38,"thread_start_us":91,"threads_started":1}
I20260929 06:37:30.142544 26918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.138041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:44011 (local address 127.0.0.1:44088)
0929 06:37:30.138411 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.138420 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.138458 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.138815 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.138817 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.138818 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:30.138852 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.138853 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.139819 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.139820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.141244 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.141247 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.142218 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.142218 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.142272 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.142275 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.142319 (+ 44us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.142349 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":3,"thread_start_us":88,"threads_started":1}
I20260929 06:37:30.142546 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.138290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35966 (local address 127.9.61.67:42919)
0929 06:37:30.138685 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.138689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.138697 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:37:30.138731 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.138733 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.138748 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.139005 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:30.139208 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.140231 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.141320 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.141798 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.141894 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.141953 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.142411 (+ 458us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.142453 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":73,"threads_started":1}
I20260929 06:37:30.142553 26921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.138480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44088 (local address 127.9.61.65:44011)
0929 06:37:30.138634 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.138639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.138650 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:37:30.138694 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.138697 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.138713 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.138818 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:30.138918 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.139715 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.141345 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.142065 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.142134 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.142189 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.142408 (+ 219us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.142467 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
I20260929 06:37:30.142889 26920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.138305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59508 (local address 127.9.61.66:34887)
0929 06:37:30.138508 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.138512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.138522 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:37:30.138570 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.138577 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.138589 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.138679 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:30.138846 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.140002 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.141346 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.142042 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.142661 (+ 619us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.142724 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.142748 (+ 24us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.142785 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":84,"threads_started":1}
I20260929 06:37:30.143469 26839 tablet_service.cc:1467] Processing CreateTablet for tablet f4cebfa7c2a04699a0fd87619014d37e (DEFAULT_TABLE table=test-table [id=cb222e5fa3524551999c680762e27c04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:30.143458 26571 tablet_service.cc:1467] Processing CreateTablet for tablet f4cebfa7c2a04699a0fd87619014d37e (DEFAULT_TABLE table=test-table [id=cb222e5fa3524551999c680762e27c04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:30.143577 26705 tablet_service.cc:1467] Processing CreateTablet for tablet f4cebfa7c2a04699a0fd87619014d37e (DEFAULT_TABLE table=test-table [id=cb222e5fa3524551999c680762e27c04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:30.143805 26839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4cebfa7c2a04699a0fd87619014d37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:30.143805 26571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4cebfa7c2a04699a0fd87619014d37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:30.143934 26705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4cebfa7c2a04699a0fd87619014d37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:30.146597 26922 tablet_bootstrap.cc:492] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595: Bootstrap starting.
I20260929 06:37:30.147034 26923 tablet_bootstrap.cc:492] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1: Bootstrap starting.
I20260929 06:37:30.147302 26924 tablet_bootstrap.cc:492] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1: Bootstrap starting.
I20260929 06:37:30.147369 26922 tablet_bootstrap.cc:654] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:30.147665 26923 tablet_bootstrap.cc:654] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:30.147907 26924 tablet_bootstrap.cc:654] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:30.148030 26922 log.cc:824] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:30.148298 26923 log.cc:824] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:30.148535 26924 log.cc:824] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:30.148820 26922 tablet_bootstrap.cc:492] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595: No bootstrap required, opened a new log
I20260929 06:37:30.148900 26922 ts_tablet_manager.cc:1397] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260929 06:37:30.149211 26924 tablet_bootstrap.cc:492] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1: No bootstrap required, opened a new log
I20260929 06:37:30.149262 26924 ts_tablet_manager.cc:1397] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:37:30.150349 26922 raft_consensus.cc:348] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059cbab9bd2242bd93569373a4024595" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 34887 } } peers { permanent_uuid: "c7d74c507f2444e789a51b6d653e55c1" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42919 } } peers { permanent_uuid: "94977da486814397b8d713de33ca03b1" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44011 } }
I20260929 06:37:30.150556 26922 raft_consensus.cc:374] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:30.150609 26922 raft_consensus.cc:729] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 059cbab9bd2242bd93569373a4024595, State: Initialized, Role: FOLLOWER
I20260929 06:37:30.150748 26922 consensus_queue.cc:260] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059cbab9bd2242bd93569373a4024595" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 34887 } } peers { permanent_uuid: "c7d74c507f2444e789a51b6d653e55c1" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42919 } } peers { permanent_uuid: "94977da486814397b8d713de33ca03b1" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44011 } }
I20260929 06:37:30.150741 26924 raft_consensus.cc:348] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059cbab9bd2242bd93569373a4024595" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 34887 } } peers { permanent_uuid: "c7d74c507f2444e789a51b6d653e55c1" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42919 } } peers { permanent_uuid: "94977da486814397b8d713de33ca03b1" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44011 } }
I20260929 06:37:30.150913 26924 raft_consensus.cc:374] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:30.150954 26924 raft_consensus.cc:729] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94977da486814397b8d713de33ca03b1, State: Initialized, Role: FOLLOWER
I20260929 06:37:30.151027 26922 ts_tablet_manager.cc:1428] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:37:30.151041 26771 heartbeater.cc:503] Master 127.9.61.126:43653 was elected leader, sending a full tablet report...
I20260929 06:37:30.151062 26924 consensus_queue.cc:260] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059cbab9bd2242bd93569373a4024595" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 34887 } } peers { permanent_uuid: "c7d74c507f2444e789a51b6d653e55c1" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42919 } } peers { permanent_uuid: "94977da486814397b8d713de33ca03b1" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44011 } }
I20260929 06:37:30.151409 26637 heartbeater.cc:503] Master 127.9.61.126:43653 was elected leader, sending a full tablet report...
I20260929 06:37:30.151630 26924 ts_tablet_manager.cc:1428] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:37:30.151672 26923 tablet_bootstrap.cc:492] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1: No bootstrap required, opened a new log
I20260929 06:37:30.151736 26923 ts_tablet_manager.cc:1397] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260929 06:37:30.153282 26923 raft_consensus.cc:348] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059cbab9bd2242bd93569373a4024595" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 34887 } } peers { permanent_uuid: "c7d74c507f2444e789a51b6d653e55c1" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42919 } } peers { permanent_uuid: "94977da486814397b8d713de33ca03b1" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44011 } }
I20260929 06:37:30.153434 26923 raft_consensus.cc:374] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:30.153478 26923 raft_consensus.cc:729] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7d74c507f2444e789a51b6d653e55c1, State: Initialized, Role: FOLLOWER
I20260929 06:37:30.153596 26923 consensus_queue.cc:260] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059cbab9bd2242bd93569373a4024595" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 34887 } } peers { permanent_uuid: "c7d74c507f2444e789a51b6d653e55c1" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42919 } } peers { permanent_uuid: "94977da486814397b8d713de33ca03b1" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44011 } }
I20260929 06:37:30.153885 26923 ts_tablet_manager.cc:1428] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:37:30.153918 26905 heartbeater.cc:503] Master 127.9.61.126:43653 was elected leader, sending a full tablet report...
I20260929 06:37:30.171561 26929 raft_consensus.cc:482] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:37:30.171677 26929 raft_consensus.cc:504] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059cbab9bd2242bd93569373a4024595" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 34887 } } peers { permanent_uuid: "c7d74c507f2444e789a51b6d653e55c1" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42919 } } peers { permanent_uuid: "94977da486814397b8d713de33ca03b1" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44011 } }
I20260929 06:37:30.172148 26929 leader_election.cc:288] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 059cbab9bd2242bd93569373a4024595 (127.9.61.66:34887), c7d74c507f2444e789a51b6d653e55c1 (127.9.61.67:42919)
I20260929 06:37:30.175297 26920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.172419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:40079 (local address 127.9.61.66:34887)
0929 06:37:30.172473 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.172475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.172483 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:37:30.172512 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.172518 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.172533 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.172616 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:30.172834 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.173460 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.174581 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.174929 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.174977 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.174986 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.175180 (+ 194us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.175223 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 06:37:30.175308 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.172412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:51327 (local address 127.9.61.67:42919)
0929 06:37:30.172467 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.172469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.172589 (+ 120us) server_negotiation.cc:407] Connection header received
0929 06:37:30.172648 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.172649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.172661 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.172732 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:30.172926 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.173495 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.174547 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.174938 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.175030 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.175040 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.175216 (+ 176us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.175252 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 06:37:30.175297 26639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.172319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:34887 (local address 127.9.61.65:40079)
0929 06:37:30.172377 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.172389 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.172429 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.172663 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.172664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.172681 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:30.172751 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.172753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.173572 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.173574 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.174488 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.174490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.175011 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.175012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.175097 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.175101 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.175154 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.175212 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":68}
I20260929 06:37:30.175314 26931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.172319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:42919 (local address 127.9.61.65:51327)
0929 06:37:30.172514 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.172525 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.172573 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.172752 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.172754 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.172756 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:30.172843 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.172845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.173599 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.173600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.174463 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.174466 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.175057 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.175058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.175122 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.175125 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.175199 (+ 74us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.175231 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":44,"thread_start_us":104,"threads_started":1}
I20260929 06:37:30.175634 26725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4cebfa7c2a04699a0fd87619014d37e" candidate_uuid: "94977da486814397b8d713de33ca03b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "059cbab9bd2242bd93569373a4024595" is_pre_election: true
I20260929 06:37:30.175796 26725 raft_consensus.cc:2454] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94977da486814397b8d713de33ca03b1 in term 0.
I20260929 06:37:30.176064 26525 leader_election.cc:302] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 059cbab9bd2242bd93569373a4024595, 94977da486814397b8d713de33ca03b1; no voters:
I20260929 06:37:30.176186 26859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4cebfa7c2a04699a0fd87619014d37e" candidate_uuid: "94977da486814397b8d713de33ca03b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d74c507f2444e789a51b6d653e55c1" is_pre_election: true
I20260929 06:37:30.176215 26929 raft_consensus.cc:2781] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:37:30.176285 26929 raft_consensus.cc:482] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:37:30.176321 26929 raft_consensus.cc:3037] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:30.176363 26859 raft_consensus.cc:2454] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94977da486814397b8d713de33ca03b1 in term 0.
I20260929 06:37:30.177096 26929 raft_consensus.cc:504] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059cbab9bd2242bd93569373a4024595" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 34887 } } peers { permanent_uuid: "c7d74c507f2444e789a51b6d653e55c1" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42919 } } peers { permanent_uuid: "94977da486814397b8d713de33ca03b1" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44011 } }
I20260929 06:37:30.177244 26929 leader_election.cc:288] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [CANDIDATE]: Term 1 election: Requested vote from peers 059cbab9bd2242bd93569373a4024595 (127.9.61.66:34887), c7d74c507f2444e789a51b6d653e55c1 (127.9.61.67:42919)
I20260929 06:37:30.177387 26859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4cebfa7c2a04699a0fd87619014d37e" candidate_uuid: "94977da486814397b8d713de33ca03b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d74c507f2444e789a51b6d653e55c1"
I20260929 06:37:30.177460 26859 raft_consensus.cc:3037] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:30.177474 26725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4cebfa7c2a04699a0fd87619014d37e" candidate_uuid: "94977da486814397b8d713de33ca03b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "059cbab9bd2242bd93569373a4024595"
I20260929 06:37:30.177546 26725 raft_consensus.cc:3037] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:30.178208 26725 raft_consensus.cc:2454] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94977da486814397b8d713de33ca03b1 in term 1.
I20260929 06:37:30.178216 26859 raft_consensus.cc:2454] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94977da486814397b8d713de33ca03b1 in term 1.
I20260929 06:37:30.178369 26525 leader_election.cc:302] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 059cbab9bd2242bd93569373a4024595, 94977da486814397b8d713de33ca03b1; no voters:
I20260929 06:37:30.178478 26929 raft_consensus.cc:2781] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:30.178668 26929 raft_consensus.cc:686] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [term 1 LEADER]: Becoming Leader. State: Replica: 94977da486814397b8d713de33ca03b1, State: Running, Role: LEADER
I20260929 06:37:30.178773 26929 consensus_queue.cc:237] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059cbab9bd2242bd93569373a4024595" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 34887 } } peers { permanent_uuid: "c7d74c507f2444e789a51b6d653e55c1" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42919 } } peers { permanent_uuid: "94977da486814397b8d713de33ca03b1" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44011 } }
I20260929 06:37:30.179517 26438 catalog_manager.cc:5495] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94977da486814397b8d713de33ca03b1 (127.9.61.65). New cstate: current_term: 1 leader_uuid: "94977da486814397b8d713de33ca03b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059cbab9bd2242bd93569373a4024595" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 34887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7d74c507f2444e789a51b6d653e55c1" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94977da486814397b8d713de33ca03b1" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44011 } health_report { overall_health: HEALTHY } } }
W20260929 06:37:30.185482 26772 tablet.cc:2369] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:37:30.186822 26921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.184158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44104 (local address 127.9.61.65:44011)
0929 06:37:30.184216 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.184218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.184228 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:37:30.184323 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.184324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.184342 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.184433 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:37:30.184567 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.185033 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.185992 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.186200 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.186282 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.186447 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:37:30.186551 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:37:30.186658 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.186698 (+ 40us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.186717 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:37:30.188366 26725 raft_consensus.cc:1261] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595 [term 1 FOLLOWER]: Refusing update from remote peer 94977da486814397b8d713de33ca03b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:37:30.188640 26859 raft_consensus.cc:1261] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1 [term 1 FOLLOWER]: Refusing update from remote peer 94977da486814397b8d713de33ca03b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:37:30.188684 26929 consensus_queue.cc:1035] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "059cbab9bd2242bd93569373a4024595" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 34887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:37:30.188916 26929 consensus_queue.cc:1035] T f4cebfa7c2a04699a0fd87619014d37e P 94977da486814397b8d713de33ca03b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7d74c507f2444e789a51b6d653e55c1" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 42919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:37:30.193523 26440 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:37:30.193631 26440 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:37:30.194345 26440 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd553e15c63e4e799d894f246bbf7416: Sending DeleteTablet for 3 replicas of tablet f4cebfa7c2a04699a0fd87619014d37e
I20260929 06:37:30.194679 26571 tablet_service.cc:1514] Processing DeleteTablet for tablet f4cebfa7c2a04699a0fd87619014d37e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:30 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:44088
I20260929 06:37:30.194813 26705 tablet_service.cc:1514] Processing DeleteTablet for tablet f4cebfa7c2a04699a0fd87619014d37e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:30 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:59508
I20260929 06:37:30.194896 26839 tablet_service.cc:1514] Processing DeleteTablet for tablet f4cebfa7c2a04699a0fd87619014d37e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:30 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:35966
I20260929 06:37:30.194929 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 26508
I20260929 06:37:30.196302 26947 tablet_replica.cc:330] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1: stopping tablet replica
I20260929 06:37:30.196419 26947 raft_consensus.cc:2229] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:37:30.196519 26947 raft_consensus.cc:2258] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:30.196944 26947 ts_tablet_manager.cc:1905] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:37:30.199062 26947 ts_tablet_manager.cc:1918] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:37:30.199141 26947 log.cc:1196] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/f4cebfa7c2a04699a0fd87619014d37e
I20260929 06:37:30.199406 26947 ts_tablet_manager.cc:1939] T f4cebfa7c2a04699a0fd87619014d37e P c7d74c507f2444e789a51b6d653e55c1: Deleting consensus metadata
I20260929 06:37:30.199816 26432 catalog_manager.cc:4841] TS c7d74c507f2444e789a51b6d653e55c1 (127.9.61.67:42919): tablet f4cebfa7c2a04699a0fd87619014d37e (table test-table [id=cb222e5fa3524551999c680762e27c04]) successfully deleted
W20260929 06:37:30.201282 26430 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:44011 (error 108)
I20260929 06:37:30.201512 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 26642
I20260929 06:37:30.201534 26946 tablet_replica.cc:330] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595: stopping tablet replica
I20260929 06:37:30.201665 26946 raft_consensus.cc:2229] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:37:30.201766 26946 raft_consensus.cc:2258] T f4cebfa7c2a04699a0fd87619014d37e P 059cbab9bd2242bd93569373a4024595 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:30.204360 26917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.204210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:44011 (local address 127.0.0.1:44110)
0929 06:37:30.204273 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.204319 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:44011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260929 06:37:30.204517 26430 catalog_manager.cc:4584] TS 94977da486814397b8d713de33ca03b1 (127.9.61.65:44011): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f4cebfa7c2a04699a0fd87619014d37e: Network error: Client connection negotiation failed: client connection to 127.9.61.65:44011: connect: Connection refused (error 111)
I20260929 06:37:30.207003 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 26776
I20260929 06:37:30.207041 26917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.206884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:34887 (local address 127.0.0.1:59516)
0929 06:37:30.206948 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.207008 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.66:34887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260929 06:37:30.211410 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 26414
2026-09-29T06:37:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (1909 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-29T06:37:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:30Z Disabled control of system clock
I20260929 06:37:30.238555 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:32859
--webserver_interface=127.9.61.126
--webserver_port=0
--builtin_ntp_servers=127.9.61.84:33725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:32859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:37:30.317477 26952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:30.317685 26952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:30.317705 26952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:30.318773 26952 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:30.318809 26952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:30.318822 26952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:30.318835 26952 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:30.318846 26952 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:30.320125 26952 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:33725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:32859
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:32859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:30.320313 26952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:30.320551 26952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:30.325241 26960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:30.325222 26957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:30.325222 26958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:30.325719 26952 server_base.cc:1034] running on GCE node
I20260929 06:37:30.325965 26952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:30.326251 26952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:30.327447 26952 hybrid_clock.cc:648] HybridClock initialized: now 1790663850327426 us; error 40 us; skew 500 ppm
I20260929 06:37:30.328806 26952 webserver.cc:460] Webserver started at http://127.9.61.126:43473/ using document root <none> and password file <none>
I20260929 06:37:30.329105 26952 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:30.329178 26952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:30.329339 26952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:30.330410 26952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "94a00f9fbc3245d1a4cc0bde580437b0"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "a7d735c1e3882d267bbbb3e34ffe5f3c"
server_key_iv: "fc4001950da859e8b58489164ec1e8bd"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.330763 26952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "94a00f9fbc3245d1a4cc0bde580437b0"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "a7d735c1e3882d267bbbb3e34ffe5f3c"
server_key_iv: "fc4001950da859e8b58489164ec1e8bd"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.332222 26952 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:37:30.332998 26966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.333195 26952 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:37:30.333309 26952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "94a00f9fbc3245d1a4cc0bde580437b0"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "a7d735c1e3882d267bbbb3e34ffe5f3c"
server_key_iv: "fc4001950da859e8b58489164ec1e8bd"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.333392 26952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:30.345412 26952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:30.345727 26952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:30.345882 26952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:30.349866 26952 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:32859
I20260929 06:37:30.349915 27018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:32859 every 8 connection(s)
I20260929 06:37:30.350272 26952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:30.351238 27019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:30.352444 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 26952
I20260929 06:37:30.352555 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:30.352737 9461 external_mini_cluster.cc:1428] Setting key 8dfd1febc9a2070c519199c965d47516
I20260929 06:37:30.353901 27019 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0: Bootstrap starting.
I20260929 06:37:30.354610 27019 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:30.354900 27019 log.cc:824] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:30.355640 27019 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0: No bootstrap required, opened a new log
I20260929 06:37:30.357906 27019 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94a00f9fbc3245d1a4cc0bde580437b0" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32859 } }
I20260929 06:37:30.358062 27019 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:30.358117 27019 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a00f9fbc3245d1a4cc0bde580437b0, State: Initialized, Role: FOLLOWER
I20260929 06:37:30.358275 27019 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94a00f9fbc3245d1a4cc0bde580437b0" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32859 } }
I20260929 06:37:30.358342 27019 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:30.358387 27019 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:30.358464 27019 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:30.358628 27022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.353280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41844 (local address 127.9.61.126:32859)
0929 06:37:30.353471 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.353479 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.353503 (+ 24us) server_negotiation.cc:407] Connection header received
0929 06:37:30.353923 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.353930 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.354057 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.354173 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:30.354412 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.355535 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.356607 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.357001 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.357100 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.357801 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:30.357805 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:30.357805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:30.357965 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:30.357996 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:30.358006 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:30.358091 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.358215 (+ 124us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.358307 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":92,"threads_started":1}
I20260929 06:37:30.359146 27019 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94a00f9fbc3245d1a4cc0bde580437b0" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32859 } }
I20260929 06:37:30.359248 27019 leader_election.cc:302] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94a00f9fbc3245d1a4cc0bde580437b0; no voters:
I20260929 06:37:30.359400 27019 leader_election.cc:288] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:30.359422 27024 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:30.359622 27024 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [term 1 LEADER]: Becoming Leader. State: Replica: 94a00f9fbc3245d1a4cc0bde580437b0, State: Running, Role: LEADER
I20260929 06:37:30.359696 27019 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:30.359733 27024 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94a00f9fbc3245d1a4cc0bde580437b0" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32859 } }
I20260929 06:37:30.360139 27025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94a00f9fbc3245d1a4cc0bde580437b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94a00f9fbc3245d1a4cc0bde580437b0" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32859 } } }
I20260929 06:37:30.360138 27026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94a00f9fbc3245d1a4cc0bde580437b0. Latest consensus state: current_term: 1 leader_uuid: "94a00f9fbc3245d1a4cc0bde580437b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94a00f9fbc3245d1a4cc0bde580437b0" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32859 } } }
I20260929 06:37:30.360252 27026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:30.360400 27025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:30.360705 27032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:30.361191 27032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:30.362766 27032 catalog_manager.cc:1347] Generated new cluster ID: bd1943fc63944cef8bccef9bd5b8ce65
I20260929 06:37:30.362840 27032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:30.375610 27032 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:30.376272 27032 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:30.378523 27032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0: Generated new TSK 0
I20260929 06:37:30.378710 27032 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:30.381793 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32859
--builtin_ntp_servers=127.9.61.84:33725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:37:30.473168 27043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:30.473410 27043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:30.473445 27043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:30.474608 27043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:30.474670 27043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:30.474711 27043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:37:30.476163 27043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:33725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:30.476426 27043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:30.476737 27043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:30.482482 27048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:30.482502 27049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:30.482739 27051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:30.482800 27043 server_base.cc:1034] running on GCE node
I20260929 06:37:30.483027 27043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:30.483294 27043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:30.484472 27043 hybrid_clock.cc:648] HybridClock initialized: now 1790663850484453 us; error 33 us; skew 500 ppm
I20260929 06:37:30.486003 27043 webserver.cc:460] Webserver started at http://127.9.61.65:33459/ using document root <none> and password file <none>
I20260929 06:37:30.486269 27043 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:30.486334 27043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:30.486470 27043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:30.487838 27043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "4fb67b1c7a088b8cb3dda4f72e4422e7"
server_key_iv: "095dc66e214aaa7258de116db70b4e92"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.488282 27043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "4fb67b1c7a088b8cb3dda4f72e4422e7"
server_key_iv: "095dc66e214aaa7258de116db70b4e92"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.489812 27043 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:37:30.490634 27057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.490804 27043 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:37:30.490882 27043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "4fb67b1c7a088b8cb3dda4f72e4422e7"
server_key_iv: "095dc66e214aaa7258de116db70b4e92"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.490972 27043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:30.512244 27043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:30.512571 27043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:30.512719 27043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:30.512948 27043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:30.513285 27043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:30.513319 27043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.513341 27043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:30.513374 27043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.519140 27043 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:42711
I20260929 06:37:30.519223 27170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:42711 every 8 connection(s)
I20260929 06:37:30.519560 27043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:37:30.524637 27022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.520326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:60341 (local address 127.9.61.126:32859)
0929 06:37:30.520410 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.520413 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.520621 (+ 208us) server_negotiation.cc:407] Connection header received
0929 06:37:30.521136 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.521137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.521147 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.521202 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:30.521958 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.522464 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.523384 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.523566 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.523616 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.524405 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:30.524406 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:30.524406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:30.524411 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:30.524424 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:30.524428 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:30.524471 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.524561 (+ 90us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.524580 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260929 06:37:30.524827 27173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.520289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32859 (local address 127.9.61.65:60341)
0929 06:37:30.520499 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.520533 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.521046 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.521275 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.521278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.521287 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:30.521884 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.521890 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.522540 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.522541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.523314 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.523316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.523633 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.523634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.523739 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.524277 (+ 538us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:37:30.524277 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:30.524305 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:37:30.524327 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:30.524479 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:30.524483 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:30.524486 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.524550 (+ 64us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.524625 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":108,"threads_started":1}
I20260929 06:37:30.525385 27171 heartbeater.cc:347] Connected to a master server at 127.9.61.126:32859
I20260929 06:37:30.525473 27171 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:30.525669 27171 heartbeater.cc:511] Master 127.9.61.126:32859 requested a full tablet report, sending...
I20260929 06:37:30.526139 26983 ts_manager.cc:194] Registered new tserver with Master: 7cc8a12ad90044d4a36bec9ad51b2e6d (127.9.61.65:42711)
I20260929 06:37:30.526747 26983 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.61.65:60341
I20260929 06:37:30.527410 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 27043
I20260929 06:37:30.527499 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:37:30.527645 9461 external_mini_cluster.cc:1428] Setting key 659c51365022a1a699f78edd046e08cd
I20260929 06:37:30.528502 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32859
--builtin_ntp_servers=127.9.61.84:33725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:37:30.610687 27174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:30.610944 27174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:30.610981 27174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:30.612200 27174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:30.612259 27174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:30.612301 27174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:37:30.613672 27174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:33725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:30.613858 27174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:30.614096 27174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:37:30.619082 27174 server_base.cc:1034] running on GCE node
W20260929 06:37:30.619023 27182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:30.619050 27179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:30.619035 27180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:30.619413 27174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:30.619663 27174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:30.620822 27174 hybrid_clock.cc:648] HybridClock initialized: now 1790663850620807 us; error 45 us; skew 500 ppm
I20260929 06:37:30.622099 27174 webserver.cc:460] Webserver started at http://127.9.61.66:35027/ using document root <none> and password file <none>
I20260929 06:37:30.622354 27174 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:30.622423 27174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:30.622602 27174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:30.623688 27174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "9ee631dd00b84f1a836be69633aab89d"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "b650d791a9178ef9cd2e60cf9d489ba8"
server_key_iv: "7fd10cccf82b18c432e8cd315519453e"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.624091 27174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "9ee631dd00b84f1a836be69633aab89d"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "b650d791a9178ef9cd2e60cf9d489ba8"
server_key_iv: "7fd10cccf82b18c432e8cd315519453e"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.625411 27174 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:37:30.626140 27188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.626302 27174 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:37:30.626397 27174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "9ee631dd00b84f1a836be69633aab89d"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "b650d791a9178ef9cd2e60cf9d489ba8"
server_key_iv: "7fd10cccf82b18c432e8cd315519453e"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.626479 27174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:30.650158 27174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:30.650501 27174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:30.650657 27174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:30.650903 27174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:30.651249 27174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:30.651304 27174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.651345 27174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:30.651373 27174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.657302 27174 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:39045
I20260929 06:37:30.657349 27301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:39045 every 8 connection(s)
I20260929 06:37:30.657719 27174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:37:30.663132 27022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.658480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:57961 (local address 127.9.61.126:32859)
0929 06:37:30.658564 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.658566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.658787 (+ 221us) server_negotiation.cc:407] Connection header received
0929 06:37:30.659265 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.659266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.659276 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.659330 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:30.660128 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.660686 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.661753 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.661935 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.661995 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.662912 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:30.662913 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:30.662913 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:30.662917 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:30.662927 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:30.662930 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:30.662971 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.663054 (+ 83us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.663072 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260929 06:37:30.663318 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 27174
I20260929 06:37:30.663436 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:37:30.663499 27304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.658456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32859 (local address 127.9.61.66:57961)
0929 06:37:30.658661 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.658695 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.659183 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.659383 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.659386 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.659394 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:30.660047 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.660059 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.660762 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.660763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.661685 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.661688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.662049 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.662050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.662168 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.662784 (+ 616us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:37:30.662785 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:30.662814 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:37:30.662838 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:30.662984 (+ 146us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:30.662988 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:30.662990 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.663041 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.663160 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":109,"threads_started":1}
I20260929 06:37:30.663656 9461 external_mini_cluster.cc:1428] Setting key 9c7afdbb833da4d3e7044ae5b762b182
I20260929 06:37:30.664067 27302 heartbeater.cc:347] Connected to a master server at 127.9.61.126:32859
I20260929 06:37:30.664163 27302 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:30.664351 27302 heartbeater.cc:511] Master 127.9.61.126:32859 requested a full tablet report, sending...
I20260929 06:37:30.664724 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32859
--builtin_ntp_servers=127.9.61.84:33725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 06:37:30.664758 26983 ts_manager.cc:194] Registered new tserver with Master: 9ee631dd00b84f1a836be69633aab89d (127.9.61.66:39045)
I20260929 06:37:30.665241 26983 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.61.66:57961
W20260929 06:37:30.744686 27305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:30.744884 27305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:30.744906 27305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:30.745950 27305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:30.745982 27305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:30.746006 27305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:37:30.747252 27305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:33725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:30.747431 27305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:30.747677 27305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:30.752483 27311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:30.752607 27313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:30.752555 27310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:30.752872 27305 server_base.cc:1034] running on GCE node
I20260929 06:37:30.753087 27305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:30.753340 27305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:30.754513 27305 hybrid_clock.cc:648] HybridClock initialized: now 1790663850754497 us; error 47 us; skew 500 ppm
I20260929 06:37:30.755717 27305 webserver.cc:460] Webserver started at http://127.9.61.67:38065/ using document root <none> and password file <none>
I20260929 06:37:30.756075 27305 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:30.756146 27305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:30.756291 27305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:30.757354 27305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "e826c7dff6df4930b9daf361c5f41f77"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "304cab43258c7d5b1f179a7598d0b5b7"
server_key_iv: "588fae5192c729dc1d41a4f93c42bb38"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.757718 27305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "e826c7dff6df4930b9daf361c5f41f77"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "304cab43258c7d5b1f179a7598d0b5b7"
server_key_iv: "588fae5192c729dc1d41a4f93c42bb38"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.759172 27305 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:37:30.760035 27319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.760241 27305 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:37:30.760339 27305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "e826c7dff6df4930b9daf361c5f41f77"
format_stamp: "Formatted at 2026-09-29 06:37:30 on dist-test-slave-601b"
server_key: "304cab43258c7d5b1f179a7598d0b5b7"
server_key_iv: "588fae5192c729dc1d41a4f93c42bb38"
server_key_version: "encryptionkey@0"
I20260929 06:37:30.760421 27305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:30.768816 27305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:30.769122 27305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:30.769266 27305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:30.769496 27305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:30.769810 27305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:30.769861 27305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.769894 27305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:30.769922 27305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:30.775532 27305 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:45005
I20260929 06:37:30.775611 27432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:45005 every 8 connection(s)
I20260929 06:37:30.776008 27305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:37:30.779577 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 27305
I20260929 06:37:30.779680 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:37:30.779858 9461 external_mini_cluster.cc:1428] Setting key 1a6681690fa65771353db05fb2fa9f9d
I20260929 06:37:30.781709 27022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.776770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:38535 (local address 127.9.61.126:32859)
0929 06:37:30.776834 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.776836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.777063 (+ 227us) server_negotiation.cc:407] Connection header received
0929 06:37:30.777656 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.777657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.777670 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.777736 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:30.778429 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.778940 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.780346 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.780539 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.780617 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.781415 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:30.781416 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:30.781417 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:30.781421 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:30.781437 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:30.781441 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:30.781509 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.781604 (+ 95us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.781632 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 06:37:30.781953 27435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.776769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:32859 (local address 127.9.61.67:38535)
0929 06:37:30.776934 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.776967 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.777546 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.777809 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.777814 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.777830 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:30.778332 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.778336 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.779042 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.779043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.780204 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.780207 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.780622 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.780623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.780758 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.781265 (+ 507us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:37:30.781266 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:30.781294 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:37:30.781315 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:30.781509 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:30.781515 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:30.781519 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.781609 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.781706 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":65,"threads_started":1}
I20260929 06:37:30.782444 27433 heartbeater.cc:347] Connected to a master server at 127.9.61.126:32859
I20260929 06:37:30.782541 27433 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:30.782684 27433 heartbeater.cc:511] Master 127.9.61.126:32859 requested a full tablet report, sending...
I20260929 06:37:30.783039 26983 ts_manager.cc:194] Registered new tserver with Master: e826c7dff6df4930b9daf361c5f41f77 (127.9.61.67:45005)
I20260929 06:37:30.783355 26983 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.61.67:38535
I20260929 06:37:30.791658 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:37:30.796146 27022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.793215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41852 (local address 127.9.61.126:32859)
0929 06:37:30.793286 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.793288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.793361 (+ 73us) server_negotiation.cc:407] Connection header received
0929 06:37:30.793419 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.793420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.793428 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.793472 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:30.793625 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.794127 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.794872 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.795051 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.795101 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.795805 (+ 704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:30.795806 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:30.795806 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:30.795810 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:30.795822 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:30.795826 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:30.795872 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.796007 (+ 135us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.796029 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 06:37:30.797750 26983 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:37:30.799289 26983 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:37:30.805866 27443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.801737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43990 (local address 127.9.61.65:42711)
0929 06:37:30.801884 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.801889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.802281 (+ 392us) server_negotiation.cc:407] Connection header received
0929 06:37:30.802424 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.802427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.802445 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.802494 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:30.802737 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.803528 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.804691 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.805462 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.805545 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.805633 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.805743 (+ 110us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.805781 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":76,"threads_started":1}
I20260929 06:37:30.805866 27442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.801660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:42711 (local address 127.0.0.1:43990)
0929 06:37:30.802148 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.802208 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.802290 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.802593 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.802593 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.802594 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:30.802655 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.802657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.803617 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.803618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.804595 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.804597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.805555 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.805557 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.805640 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.805653 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.805720 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.805779 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":40,"thread_start_us":79,"threads_started":1}
I20260929 06:37:30.806069 27445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.801989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49818 (local address 127.9.61.67:45005)
0929 06:37:30.802170 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.802174 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.802460 (+ 286us) server_negotiation.cc:407] Connection header received
0929 06:37:30.802587 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.802590 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.802607 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.802657 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:30.802908 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.803606 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.804999 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.805588 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.805635 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.805721 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.805923 (+ 202us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.805967 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":82,"threads_started":1}
I20260929 06:37:30.806243 27446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.802173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:45005 (local address 127.0.0.1:49818)
0929 06:37:30.802385 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.802395 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.802490 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.802773 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.802774 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.802776 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:30.802825 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.802826 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.803703 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.803704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.804903 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.804906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.805780 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.805780 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.805835 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.805838 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.806143 (+ 305us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.806182 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":82,"threads_started":1}
I20260929 06:37:30.807090 27441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.801664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:39045 (local address 127.0.0.1:43708)
0929 06:37:30.802215 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.802224 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.802305 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.802576 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.802579 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.802582 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:30.802655 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.802658 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.804854 (+ 2196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.804855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.805867 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.805870 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.806846 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.806847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.806907 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.806911 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.806973 (+ 62us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.807011 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":99,"threads_started":1}
I20260929 06:37:30.807111 27444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.801784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43708 (local address 127.9.61.66:39045)
0929 06:37:30.801983 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.801987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.802311 (+ 324us) server_negotiation.cc:407] Connection header received
0929 06:37:30.802391 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.802394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.802411 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.802469 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:30.803621 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.804770 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.805961 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.806752 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.806824 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.806902 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.806982 (+ 80us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.807016 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":80,"threads_started":1}
I20260929 06:37:30.807058 27367 tablet_service.cc:1467] Processing CreateTablet for tablet 8d0fc3806487403cb687823210d45c7e (DEFAULT_TABLE table=test-table [id=539fbad4b0644921b4ad44ad50ec7c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:30.807142 27105 tablet_service.cc:1467] Processing CreateTablet for tablet 8d0fc3806487403cb687823210d45c7e (DEFAULT_TABLE table=test-table [id=539fbad4b0644921b4ad44ad50ec7c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:30.807488 27367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d0fc3806487403cb687823210d45c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:30.807497 27105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d0fc3806487403cb687823210d45c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:30.807837 27236 tablet_service.cc:1467] Processing CreateTablet for tablet 8d0fc3806487403cb687823210d45c7e (DEFAULT_TABLE table=test-table [id=539fbad4b0644921b4ad44ad50ec7c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:30.808173 27236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d0fc3806487403cb687823210d45c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:30.810006 27447 tablet_bootstrap.cc:492] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77: Bootstrap starting.
I20260929 06:37:30.810669 27447 tablet_bootstrap.cc:654] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:30.810848 27448 tablet_bootstrap.cc:492] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d: Bootstrap starting.
I20260929 06:37:30.811004 27447 log.cc:824] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:30.811363 27450 tablet_bootstrap.cc:492] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d: Bootstrap starting.
I20260929 06:37:30.811479 27448 tablet_bootstrap.cc:654] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:30.811800 27448 log.cc:824] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:30.812052 27450 tablet_bootstrap.cc:654] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:30.812057 27447 tablet_bootstrap.cc:492] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77: No bootstrap required, opened a new log
I20260929 06:37:30.812121 27447 ts_tablet_manager.cc:1397] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:37:30.812347 27450 log.cc:824] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:30.812577 27448 tablet_bootstrap.cc:492] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d: No bootstrap required, opened a new log
I20260929 06:37:30.812673 27448 ts_tablet_manager.cc:1397] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260929 06:37:30.813061 27450 tablet_bootstrap.cc:492] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d: No bootstrap required, opened a new log
I20260929 06:37:30.813189 27450 ts_tablet_manager.cc:1397] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260929 06:37:30.814234 27447 raft_consensus.cc:348] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 42711 } } peers { permanent_uuid: "9ee631dd00b84f1a836be69633aab89d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39045 } } peers { permanent_uuid: "e826c7dff6df4930b9daf361c5f41f77" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45005 } }
I20260929 06:37:30.814363 27447 raft_consensus.cc:374] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:30.814384 27447 raft_consensus.cc:729] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e826c7dff6df4930b9daf361c5f41f77, State: Initialized, Role: FOLLOWER
I20260929 06:37:30.814513 27447 consensus_queue.cc:260] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 42711 } } peers { permanent_uuid: "9ee631dd00b84f1a836be69633aab89d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39045 } } peers { permanent_uuid: "e826c7dff6df4930b9daf361c5f41f77" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45005 } }
I20260929 06:37:30.814785 27447 ts_tablet_manager.cc:1428] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:37:30.814811 27433 heartbeater.cc:503] Master 127.9.61.126:32859 was elected leader, sending a full tablet report...
I20260929 06:37:30.815352 27448 raft_consensus.cc:348] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 42711 } } peers { permanent_uuid: "9ee631dd00b84f1a836be69633aab89d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39045 } } peers { permanent_uuid: "e826c7dff6df4930b9daf361c5f41f77" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45005 } }
I20260929 06:37:30.815507 27448 raft_consensus.cc:374] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:30.815557 27448 raft_consensus.cc:729] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cc8a12ad90044d4a36bec9ad51b2e6d, State: Initialized, Role: FOLLOWER
I20260929 06:37:30.815682 27448 consensus_queue.cc:260] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 42711 } } peers { permanent_uuid: "9ee631dd00b84f1a836be69633aab89d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39045 } } peers { permanent_uuid: "e826c7dff6df4930b9daf361c5f41f77" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45005 } }
I20260929 06:37:30.815989 27171 heartbeater.cc:503] Master 127.9.61.126:32859 was elected leader, sending a full tablet report...
I20260929 06:37:30.815976 27448 ts_tablet_manager.cc:1428] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260929 06:37:30.816627 27450 raft_consensus.cc:348] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 42711 } } peers { permanent_uuid: "9ee631dd00b84f1a836be69633aab89d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39045 } } peers { permanent_uuid: "e826c7dff6df4930b9daf361c5f41f77" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45005 } }
I20260929 06:37:30.816776 27450 raft_consensus.cc:374] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:30.816816 27450 raft_consensus.cc:729] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee631dd00b84f1a836be69633aab89d, State: Initialized, Role: FOLLOWER
I20260929 06:37:30.816921 27450 consensus_queue.cc:260] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 42711 } } peers { permanent_uuid: "9ee631dd00b84f1a836be69633aab89d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39045 } } peers { permanent_uuid: "e826c7dff6df4930b9daf361c5f41f77" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45005 } }
I20260929 06:37:30.817178 27450 ts_tablet_manager.cc:1428] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260929 06:37:30.817209 27302 heartbeater.cc:503] Master 127.9.61.126:32859 was elected leader, sending a full tablet report...
I20260929 06:37:30.889488 27455 raft_consensus.cc:482] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:37:30.889654 27455 raft_consensus.cc:504] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 42711 } } peers { permanent_uuid: "9ee631dd00b84f1a836be69633aab89d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39045 } } peers { permanent_uuid: "e826c7dff6df4930b9daf361c5f41f77" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45005 } }
I20260929 06:37:30.890053 27455 leader_election.cc:288] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cc8a12ad90044d4a36bec9ad51b2e6d (127.9.61.65:42711), e826c7dff6df4930b9daf361c5f41f77 (127.9.61.67:45005)
I20260929 06:37:30.893235 27304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.890235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:42711 (local address 127.9.61.66:43787)
0929 06:37:30.890313 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.890327 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.890396 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.890562 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.890563 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.890565 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:30.890666 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.890669 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.891440 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.891441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.892377 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.892380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.892943 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.892944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.893025 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.893029 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.893092 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.893142 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260929 06:37:30.893326 27445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.890457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:48337 (local address 127.9.61.67:45005)
0929 06:37:30.890503 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.890505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.890602 (+ 97us) server_negotiation.cc:407] Connection header received
0929 06:37:30.890639 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.890640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.890651 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.890719 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:30.890959 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.891468 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.892564 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.892948 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.893036 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.893047 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.893209 (+ 162us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.893253 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:37:30.893528 27456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.890368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:45005 (local address 127.9.61.66:48337)
0929 06:37:30.890527 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.890537 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:30.890590 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:30.890778 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:30.890779 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:30.890781 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:30.890850 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.890851 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.891551 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.891552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.892468 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:30.892470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.893045 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.893046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:30.893135 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.893140 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:37:30.893184 (+ 44us) client_negotiation.cc:240] Negotiation successful
0929 06:37:30.893212 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":1,"thread_start_us":100,"threads_started":1}
I20260929 06:37:30.893705 27443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.890326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:43787 (local address 127.9.61.65:42711)
0929 06:37:30.890412 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.890415 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.890426 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:37:30.890457 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.890458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.890470 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.890525 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:30.890780 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.891338 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.892462 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.892851 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.892907 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.892917 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.893282 (+ 365us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.893640 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260929 06:37:30.893889 27387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d0fc3806487403cb687823210d45c7e" candidate_uuid: "9ee631dd00b84f1a836be69633aab89d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e826c7dff6df4930b9daf361c5f41f77" is_pre_election: true
I20260929 06:37:30.893985 27125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d0fc3806487403cb687823210d45c7e" candidate_uuid: "9ee631dd00b84f1a836be69633aab89d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d" is_pre_election: true
I20260929 06:37:30.894055 27387 raft_consensus.cc:2454] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ee631dd00b84f1a836be69633aab89d in term 0.
I20260929 06:37:30.894161 27125 raft_consensus.cc:2454] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ee631dd00b84f1a836be69633aab89d in term 0.
I20260929 06:37:30.894333 27192 leader_election.cc:302] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee631dd00b84f1a836be69633aab89d, e826c7dff6df4930b9daf361c5f41f77; no voters:
I20260929 06:37:30.894524 27455 raft_consensus.cc:2781] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:37:30.894598 27455 raft_consensus.cc:482] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:37:30.894615 27455 raft_consensus.cc:3037] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:30.895370 27455 raft_consensus.cc:504] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 42711 } } peers { permanent_uuid: "9ee631dd00b84f1a836be69633aab89d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39045 } } peers { permanent_uuid: "e826c7dff6df4930b9daf361c5f41f77" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45005 } }
I20260929 06:37:30.895502 27455 leader_election.cc:288] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [CANDIDATE]: Term 1 election: Requested vote from peers 7cc8a12ad90044d4a36bec9ad51b2e6d (127.9.61.65:42711), e826c7dff6df4930b9daf361c5f41f77 (127.9.61.67:45005)
I20260929 06:37:30.895684 27125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d0fc3806487403cb687823210d45c7e" candidate_uuid: "9ee631dd00b84f1a836be69633aab89d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d"
I20260929 06:37:30.895704 27387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d0fc3806487403cb687823210d45c7e" candidate_uuid: "9ee631dd00b84f1a836be69633aab89d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e826c7dff6df4930b9daf361c5f41f77"
I20260929 06:37:30.895766 27125 raft_consensus.cc:3037] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:30.895787 27387 raft_consensus.cc:3037] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:30.896656 27387 raft_consensus.cc:2454] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee631dd00b84f1a836be69633aab89d in term 1.
I20260929 06:37:30.896648 27125 raft_consensus.cc:2454] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee631dd00b84f1a836be69633aab89d in term 1.
I20260929 06:37:30.896826 27192 leader_election.cc:302] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7cc8a12ad90044d4a36bec9ad51b2e6d, 9ee631dd00b84f1a836be69633aab89d; no voters:
I20260929 06:37:30.896930 27455 raft_consensus.cc:2781] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:30.897089 27455 raft_consensus.cc:686] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 1 LEADER]: Becoming Leader. State: Replica: 9ee631dd00b84f1a836be69633aab89d, State: Running, Role: LEADER
I20260929 06:37:30.897192 27455 consensus_queue.cc:237] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 42711 } } peers { permanent_uuid: "9ee631dd00b84f1a836be69633aab89d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39045 } } peers { permanent_uuid: "e826c7dff6df4930b9daf361c5f41f77" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45005 } }
I20260929 06:37:30.898005 26983 catalog_manager.cc:5495] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ee631dd00b84f1a836be69633aab89d (127.9.61.66). New cstate: current_term: 1 leader_uuid: "9ee631dd00b84f1a836be69633aab89d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee631dd00b84f1a836be69633aab89d" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 39045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e826c7dff6df4930b9daf361c5f41f77" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45005 } health_report { overall_health: UNKNOWN } } }
W20260929 06:37:30.908275 27303 tablet.cc:2369] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:37:30.924770 27444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.922323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43724 (local address 127.9.61.66:39045)
0929 06:37:30.922395 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:30.922397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:30.922404 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:37:30.922442 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:30.922442 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:30.922461 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:30.922546 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:37:30.922677 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.923140 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.923967 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:30.924169 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:30.924249 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:30.924411 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:37:30.924517 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:37:30.924614 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:30.924634 (+ 20us) server_negotiation.cc:299] Negotiation successful
0929 06:37:30.924651 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:37:30.926542 27125 raft_consensus.cc:1261] T 8d0fc3806487403cb687823210d45c7e P 7cc8a12ad90044d4a36bec9ad51b2e6d [term 1 FOLLOWER]: Refusing update from remote peer 9ee631dd00b84f1a836be69633aab89d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:37:30.926548 27387 raft_consensus.cc:1261] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77 [term 1 FOLLOWER]: Refusing update from remote peer 9ee631dd00b84f1a836be69633aab89d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:37:30.926954 27457 consensus_queue.cc:1035] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cc8a12ad90044d4a36bec9ad51b2e6d" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:37:30.927109 27455 consensus_queue.cc:1035] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e826c7dff6df4930b9daf361c5f41f77" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:37:30.929214 27460 mvcc.cc:205] Tried to move back new op lower bound from 7334559133392203776 to 7334559133275627520. Current Snapshot: MvccSnapshot[applied={T|T < 7334559133392203776}]
I20260929 06:37:30.929697 27461 mvcc.cc:205] Tried to move back new op lower bound from 7334559133392203776 to 7334559133275627520. Current Snapshot: MvccSnapshot[applied={T|T < 7334559133392203776}]
I20260929 06:37:30.930613 27463 mvcc.cc:205] Tried to move back new op lower bound from 7334559133392203776 to 7334559133275627520. Current Snapshot: MvccSnapshot[applied={T|T < 7334559133392203776}]
I20260929 06:37:30.931365 26982 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:37:30.931461 26982 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:37:30.932241 26982 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 94a00f9fbc3245d1a4cc0bde580437b0: Sending DeleteTablet for 3 replicas of tablet 8d0fc3806487403cb687823210d45c7e
I20260929 06:37:30.932627 27105 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d0fc3806487403cb687823210d45c7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:30 UTC) from {username='slave'} at 127.0.0.1:43990
I20260929 06:37:30.932621 27367 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d0fc3806487403cb687823210d45c7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:30 UTC) from {username='slave'} at 127.0.0.1:49818
I20260929 06:37:30.932775 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 27043
I20260929 06:37:30.933292 27470 tablet_replica.cc:330] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77: stopping tablet replica
I20260929 06:37:30.933405 27470 raft_consensus.cc:2229] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:37:30.933514 27470 raft_consensus.cc:2258] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:30.933722 27236 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d0fc3806487403cb687823210d45c7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:30 UTC) from {username='slave'} at 127.0.0.1:43708
I20260929 06:37:30.933947 27471 tablet_replica.cc:330] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d: stopping tablet replica
I20260929 06:37:30.934043 27471 raft_consensus.cc:2229] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:37:30.934135 27471 raft_consensus.cc:2258] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:30.934136 27470 ts_tablet_manager.cc:1905] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:37:30.934571 27471 ts_tablet_manager.cc:1905] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:37:30.936241 27471 ts_tablet_manager.cc:1918] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:37:30.936316 27471 log.cc:1196] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/8d0fc3806487403cb687823210d45c7e
I20260929 06:37:30.936281 27470 ts_tablet_manager.cc:1918] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:37:30.936583 27471 ts_tablet_manager.cc:1939] T 8d0fc3806487403cb687823210d45c7e P 9ee631dd00b84f1a836be69633aab89d: Deleting consensus metadata
I20260929 06:37:30.936594 27470 log.cc:1196] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/8d0fc3806487403cb687823210d45c7e
I20260929 06:37:30.936993 27470 ts_tablet_manager.cc:1939] T 8d0fc3806487403cb687823210d45c7e P e826c7dff6df4930b9daf361c5f41f77: Deleting consensus metadata
I20260929 06:37:30.937004 26969 catalog_manager.cc:4841] TS 9ee631dd00b84f1a836be69633aab89d (127.9.61.66:39045): tablet 8d0fc3806487403cb687823210d45c7e (table test-table [id=539fbad4b0644921b4ad44ad50ec7c47]) successfully deleted
I20260929 06:37:30.937436 26970 catalog_manager.cc:4841] TS e826c7dff6df4930b9daf361c5f41f77 (127.9.61.67:45005): tablet 8d0fc3806487403cb687823210d45c7e (table test-table [id=539fbad4b0644921b4ad44ad50ec7c47]) successfully deleted
W20260929 06:37:30.940225 26970 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:42711 (error 108)
I20260929 06:37:30.940712 27441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:30.940570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:42711 (local address 127.0.0.1:44000)
0929 06:37:30.940633 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:30.940678 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:42711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260929 06:37:30.940770 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 27174
W20260929 06:37:30.943737 26970 catalog_manager.cc:4584] TS 7cc8a12ad90044d4a36bec9ad51b2e6d (127.9.61.65:42711): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8d0fc3806487403cb687823210d45c7e: Network error: Client connection negotiation failed: client connection to 127.9.61.65:42711: connect: Connection refused (error 111)
I20260929 06:37:30.947196 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 27305
I20260929 06:37:30.952132 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 26952
2026-09-29T06:37:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (739 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:31 dist-test-slave-601b krb5kdc[27475](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:31 dist-test-slave-601b krb5kdc[27475](info): set up 2 sockets
Sep 29 06:37:31 dist-test-slave-601b krb5kdc[27475](info): commencing operation
krb5kdc: starting...
W20260929 06:37:32.015774 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:32 dist-test-slave-601b krb5kdc[27475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:37:32.130610 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41585
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:41585
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:32.210857 27488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:32.211082 27488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:32.211104 27488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:32.212213 27488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:32.212247 27488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:32.212261 27488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:32.212275 27488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:32.212286 27488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:32.213704 27488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:41585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:32.213907 27488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:32.214076 27488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:32.218988 27494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:32.218906 27493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:32.218917 27496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:32.219158 27488 server_base.cc:1034] running on GCE node
I20260929 06:37:32.219441 27488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:32.219688 27488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:32.220825 27488 hybrid_clock.cc:648] HybridClock initialized: now 1790663852220808 us; error 37 us; skew 500 ppm
Sep 29 06:37:32 dist-test-slave-601b krb5kdc[27475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:32.223345 27488 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:37:32.223830 27488 webserver.cc:460] Webserver started at http://127.9.61.126:39063/ using document root <none> and password file <none>
I20260929 06:37:32.224114 27488 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:32.224185 27488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:32.224344 27488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:32.225420 27488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "6a47bfad0cf24791897c50b90abc5a21"
format_stamp: "Formatted at 2026-09-29 06:37:32 on dist-test-slave-601b"
server_key: "cb22e41fa56ebd0fa820be14e183d66d"
server_key_iv: "a440687fd5ff578d05f79600bcb4ac48"
server_key_version: "encryptionkey@0"
I20260929 06:37:32.225793 27488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "6a47bfad0cf24791897c50b90abc5a21"
format_stamp: "Formatted at 2026-09-29 06:37:32 on dist-test-slave-601b"
server_key: "cb22e41fa56ebd0fa820be14e183d66d"
server_key_iv: "a440687fd5ff578d05f79600bcb4ac48"
server_key_version: "encryptionkey@0"
I20260929 06:37:32.227113 27488 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:37:32.227813 27503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:32.228039 27488 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:32.228152 27488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "6a47bfad0cf24791897c50b90abc5a21"
format_stamp: "Formatted at 2026-09-29 06:37:32 on dist-test-slave-601b"
server_key: "cb22e41fa56ebd0fa820be14e183d66d"
server_key_iv: "a440687fd5ff578d05f79600bcb4ac48"
server_key_version: "encryptionkey@0"
I20260929 06:37:32.228232 27488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:32.238341 27488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:32.240538 27488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:32.240705 27488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:32.244716 27488 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:41585
I20260929 06:37:32.244752 27555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:41585 every 8 connection(s)
I20260929 06:37:32.245105 27488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:32.245913 27556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:32.248068 27556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21: Bootstrap starting.
I20260929 06:37:32.248565 27556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:32.248795 27556 log.cc:824] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:32.249480 27556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21: No bootstrap required, opened a new log
I20260929 06:37:32.250948 27556 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a47bfad0cf24791897c50b90abc5a21" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41585 } }
I20260929 06:37:32.251087 27556 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:32.251111 27556 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a47bfad0cf24791897c50b90abc5a21, State: Initialized, Role: FOLLOWER
I20260929 06:37:32.251243 27556 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a47bfad0cf24791897c50b90abc5a21" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41585 } }
I20260929 06:37:32.251323 27556 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:32.251345 27556 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:32.251374 27556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:32.251824 27556 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a47bfad0cf24791897c50b90abc5a21" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41585 } }
I20260929 06:37:32.251904 27556 leader_election.cc:302] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a47bfad0cf24791897c50b90abc5a21; no voters:
I20260929 06:37:32.252090 27556 leader_election.cc:288] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:32.252166 27559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:32.252357 27559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [term 1 LEADER]: Becoming Leader. State: Replica: 6a47bfad0cf24791897c50b90abc5a21, State: Running, Role: LEADER
I20260929 06:37:32.252388 27556 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:32.252447 27559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a47bfad0cf24791897c50b90abc5a21" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41585 } }
I20260929 06:37:32.252873 27561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a47bfad0cf24791897c50b90abc5a21. Latest consensus state: current_term: 1 leader_uuid: "6a47bfad0cf24791897c50b90abc5a21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a47bfad0cf24791897c50b90abc5a21" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41585 } } }
I20260929 06:37:32.252961 27561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:32.253118 27560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a47bfad0cf24791897c50b90abc5a21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a47bfad0cf24791897c50b90abc5a21" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41585 } } }
I20260929 06:37:32.253171 27568 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:32.253239 27560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:32.253896 27568 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:32.255144 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 27488
I20260929 06:37:32.255276 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:32.255489 9461 external_mini_cluster.cc:1428] Setting key e108ce358f449725820a943ecba9fc47
I20260929 06:37:32.255513 27568 catalog_manager.cc:1347] Generated new cluster ID: b60e213a80814af1bc494e35d8238f65
I20260929 06:37:32.255551 27568 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:37:32 dist-test-slave-601b krb5kdc[27475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:32.266887 27568 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:32.266970 27579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.256128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39886 (local address 127.9.61.126:41585)
0929 06:37:32.256274 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:32.256285 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:32.256315 (+ 30us) server_negotiation.cc:407] Connection header received
0929 06:37:32.256426 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:32.256433 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:32.256500 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:32.256646 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:32.257328 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.258751 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.259783 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.260496 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.260634 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.263356 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:32.263361 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:32.263361 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:32.263372 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:32.265331 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:32.265742 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:32.265745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:32.265745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:32.265860 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:32.266074 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:32.266075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:32.266075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:32.266333 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:32.266487 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:32.266608 (+ 121us) server_negotiation.cc:299] Negotiation successful
0929 06:37:32.266752 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":64,"threads_started":1}
I20260929 06:37:32.267792 27568 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:32.281615 27568 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21: Generated new TSK 0
I20260929 06:37:32.281827 27568 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:37:32.310717 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41585
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:32.410140 27582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:32.410336 27582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:32.410359 27582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:32.411540 27582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:32.411582 27582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:32.411608 27582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:37:32.413105 27582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:32.413350 27582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:32.413578 27582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:32.418588 27588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:32.418630 27587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:32.418612 27590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:32.418825 27582 server_base.cc:1034] running on GCE node
I20260929 06:37:32.419034 27582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:32.419286 27582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:32.420447 27582 hybrid_clock.cc:648] HybridClock initialized: now 1790663852420438 us; error 36 us; skew 500 ppm
Sep 29 06:37:32 dist-test-slave-601b krb5kdc[27475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:32.422849 27582 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:37:32.423260 27582 webserver.cc:460] Webserver started at http://127.9.61.65:38301/ using document root <none> and password file <none>
I20260929 06:37:32.423497 27582 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:32.423578 27582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:32.423725 27582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:32.424827 27582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "69ea7e7d631940f7b73675ea6e6d294c"
format_stamp: "Formatted at 2026-09-29 06:37:32 on dist-test-slave-601b"
server_key: "fd17eecec737b3749b85213ae91ee5df"
server_key_iv: "56d98b7593f2684c6d67821071c3a32e"
server_key_version: "encryptionkey@0"
I20260929 06:37:32.425266 27582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "69ea7e7d631940f7b73675ea6e6d294c"
format_stamp: "Formatted at 2026-09-29 06:37:32 on dist-test-slave-601b"
server_key: "fd17eecec737b3749b85213ae91ee5df"
server_key_iv: "56d98b7593f2684c6d67821071c3a32e"
server_key_version: "encryptionkey@0"
I20260929 06:37:32.426611 27582 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:37:32.427316 27597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:32.427492 27582 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:37:32.427608 27582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "69ea7e7d631940f7b73675ea6e6d294c"
format_stamp: "Formatted at 2026-09-29 06:37:32 on dist-test-slave-601b"
server_key: "fd17eecec737b3749b85213ae91ee5df"
server_key_iv: "56d98b7593f2684c6d67821071c3a32e"
server_key_version: "encryptionkey@0"
I20260929 06:37:32.427681 27582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:32.438066 27582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:32.439915 27582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:32.440130 27582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:32.440460 27582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:32.440773 27582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:32.440827 27582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:32.440867 27582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:32.440908 27582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:32.446619 27582 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:44189
I20260929 06:37:32.446658 27710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:44189 every 8 connection(s)
I20260929 06:37:32.446981 27582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:37:32 dist-test-slave-601b krb5kdc[27475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:32.456256 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 27582
I20260929 06:37:32.456394 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:37:32.456557 27579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.447763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:57465 (local address 127.9.61.126:41585)
0929 06:37:32.447813 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:32.447815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:32.448092 (+ 277us) server_negotiation.cc:407] Connection header received
0929 06:37:32.448613 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:32.448614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:32.448627 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:32.448694 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:32.449626 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.450148 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.451155 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.451354 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.451451 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.453744 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:32.453746 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:32.453746 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:32.453754 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:32.455027 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:32.455431 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:32.455432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:32.455433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:32.455508 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:32.455757 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:32.455758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:32.455759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:32.455874 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:32.455977 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:32.456351 (+ 374us) server_negotiation.cc:299] Negotiation successful
0929 06:37:32.456456 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:37:32.456602 9461 external_mini_cluster.cc:1428] Setting key d73dc4e4ed1d995eb1af0b10c334cff5
I20260929 06:37:32.456705 27713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.447734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41585 (local address 127.9.61.65:57465)
0929 06:37:32.447909 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:32.448001 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:32.448511 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:32.448765 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:32.448769 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:32.449334 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:32.449525 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.449530 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.450244 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.450245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.451050 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.451052 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.451460 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.451461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.451596 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.452174 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:37:32.452182 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:32.453637 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:32.455118 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:32.455124 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:32.455126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:32.455341 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:32.455585 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:32.455586 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:32.455586 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:32.455689 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:32.455983 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:32.455990 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:32.456171 (+ 181us) client_negotiation.cc:769] Sending connection context
0929 06:37:32.456298 (+ 127us) client_negotiation.cc:240] Negotiation successful
0929 06:37:32.456476 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
I20260929 06:37:32.457417 27711 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41585
I20260929 06:37:32.457556 27711 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:32.457732 27711 heartbeater.cc:511] Master 127.9.61.126:41585 requested a full tablet report, sending...
I20260929 06:37:32.458302 27520 ts_manager.cc:194] Registered new tserver with Master: 69ea7e7d631940f7b73675ea6e6d294c (127.9.61.65:44189)
I20260929 06:37:32.459090 27520 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:57465
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:37:32.480134 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41585
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:32.559710 27716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:32.559971 27716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:32.560019 27716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:32.561175 27716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:32.561240 27716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:32.561285 27716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:37:32.562711 27716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:32.562968 27716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:32.563194 27716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:32.568008 27724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:32.568019 27721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:32.568001 27722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:32.568157 27716 server_base.cc:1034] running on GCE node
I20260929 06:37:32.568327 27716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:32.568584 27716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:32.569743 27716 hybrid_clock.cc:648] HybridClock initialized: now 1790663852569735 us; error 43 us; skew 500 ppm
Sep 29 06:37:32 dist-test-slave-601b krb5kdc[27475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:32.572402 27716 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:37:32.572824 27716 webserver.cc:460] Webserver started at http://127.9.61.66:36119/ using document root <none> and password file <none>
I20260929 06:37:32.573107 27716 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:32.573186 27716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:32.573318 27716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:32.574743 27716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "39fb48c2aab94889a2475f6b30fd1154"
format_stamp: "Formatted at 2026-09-29 06:37:32 on dist-test-slave-601b"
server_key: "9700a7b368b2e1953090bd0729747b2f"
server_key_iv: "f1c2abf96e0a992a97ef933a9cd425b9"
server_key_version: "encryptionkey@0"
I20260929 06:37:32.575165 27716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "39fb48c2aab94889a2475f6b30fd1154"
format_stamp: "Formatted at 2026-09-29 06:37:32 on dist-test-slave-601b"
server_key: "9700a7b368b2e1953090bd0729747b2f"
server_key_iv: "f1c2abf96e0a992a97ef933a9cd425b9"
server_key_version: "encryptionkey@0"
I20260929 06:37:32.576527 27716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:37:32.577327 27731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:32.577502 27716 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:37:32.577589 27716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "39fb48c2aab94889a2475f6b30fd1154"
format_stamp: "Formatted at 2026-09-29 06:37:32 on dist-test-slave-601b"
server_key: "9700a7b368b2e1953090bd0729747b2f"
server_key_iv: "f1c2abf96e0a992a97ef933a9cd425b9"
server_key_version: "encryptionkey@0"
I20260929 06:37:32.577672 27716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:32.585541 27716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:32.587743 27716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:32.587891 27716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:32.588143 27716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:32.588433 27716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:32.588486 27716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:32.588521 27716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:32.588547 27716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:32.594074 27716 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:37705
I20260929 06:37:32.594126 27844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:37705 every 8 connection(s)
I20260929 06:37:32.594440 27716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:37:32 dist-test-slave-601b krb5kdc[27475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:32.602830 27579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.595163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:54475 (local address 127.9.61.126:41585)
0929 06:37:32.595240 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:32.595242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:32.595401 (+ 159us) server_negotiation.cc:407] Connection header received
0929 06:37:32.595863 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:32.595864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:32.595875 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:32.595927 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:32.596882 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.597365 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.598298 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.598472 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.598520 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.600566 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:32.600568 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:32.600568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:32.600575 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:32.601731 (+ 1156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:32.602083 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:32.602084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:32.602084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:32.602133 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:32.602340 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:32.602341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:32.602341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:32.602436 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:32.602488 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:32.602706 (+ 218us) server_negotiation.cc:299] Negotiation successful
0929 06:37:32.602767 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260929 06:37:32.602984 27847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.595114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41585 (local address 127.9.61.66:54475)
0929 06:37:32.595285 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:32.595319 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:32.595782 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:32.596036 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:32.596040 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:32.596609 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:32.596796 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.596801 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.597440 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.597441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.598221 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.598223 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.598540 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.598541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.598635 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.599083 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:37:32.599092 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:32.600481 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:32.601799 (+ 1318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:32.601804 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:32.601806 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:32.602016 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:32.602193 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:32.602193 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:32.602194 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:32.602286 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:32.602488 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:32.602493 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:32.602603 (+ 110us) client_negotiation.cc:769] Sending connection context
0929 06:37:32.602680 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 06:37:32.602793 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":96,"threads_started":1}
I20260929 06:37:32.603447 27845 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41585
I20260929 06:37:32.603538 27845 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:32.603683 27845 heartbeater.cc:511] Master 127.9.61.126:41585 requested a full tablet report, sending...
I20260929 06:37:32.604084 27520 ts_manager.cc:194] Registered new tserver with Master: 39fb48c2aab94889a2475f6b30fd1154 (127.9.61.66:37705)
I20260929 06:37:32.604368 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 27716
I20260929 06:37:32.604485 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:37:32.604614 27520 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:54475
I20260929 06:37:32.604660 9461 external_mini_cluster.cc:1428] Setting key bd2a8d994298cbbf1aba972d035e5105
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:37:32.626971 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41585
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:32.706494 27850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:32.706689 27850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:32.706712 27850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:32.707875 27850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:32.707916 27850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:32.708000 27850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:37:32.709461 27850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:41585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:32.709713 27850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:32.709950 27850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:32.714803 27855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:32.714860 27858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:32.715054 27850 server_base.cc:1034] running on GCE node
W20260929 06:37:32.714803 27856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:32.715291 27850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:32.715476 27850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:32.716637 27850 hybrid_clock.cc:648] HybridClock initialized: now 1790663852716618 us; error 30 us; skew 500 ppm
Sep 29 06:37:32 dist-test-slave-601b krb5kdc[27475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:32.719077 27850 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:37:32.719491 27850 webserver.cc:460] Webserver started at http://127.9.61.67:38379/ using document root <none> and password file <none>
I20260929 06:37:32.719732 27850 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:32.719800 27850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:32.720000 27850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:32.721019 27850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "00a7dcd7c3234762af80629bd0ad7c1d"
format_stamp: "Formatted at 2026-09-29 06:37:32 on dist-test-slave-601b"
server_key: "9bf49da0d29882d1f90526744f935dbb"
server_key_iv: "6373cfc28350bd75ab73c5484a8e6a00"
server_key_version: "encryptionkey@0"
I20260929 06:37:32.721402 27850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "00a7dcd7c3234762af80629bd0ad7c1d"
format_stamp: "Formatted at 2026-09-29 06:37:32 on dist-test-slave-601b"
server_key: "9bf49da0d29882d1f90526744f935dbb"
server_key_iv: "6373cfc28350bd75ab73c5484a8e6a00"
server_key_version: "encryptionkey@0"
I20260929 06:37:32.722693 27850 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:37:32.723372 27865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:32.723537 27850 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:37:32.723641 27850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "00a7dcd7c3234762af80629bd0ad7c1d"
format_stamp: "Formatted at 2026-09-29 06:37:32 on dist-test-slave-601b"
server_key: "9bf49da0d29882d1f90526744f935dbb"
server_key_iv: "6373cfc28350bd75ab73c5484a8e6a00"
server_key_version: "encryptionkey@0"
I20260929 06:37:32.723721 27850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:32.757236 27850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:32.759681 27850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:32.759848 27850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:32.760119 27850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:32.760442 27850 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:32.760495 27850 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:32.760541 27850 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:32.760579 27850 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:32.766353 27850 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:38143
I20260929 06:37:32.766398 27978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:38143 every 8 connection(s)
I20260929 06:37:32.766753 27850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:37:32.771976 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 27850
I20260929 06:37:32.772085 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:37:32.772267 9461 external_mini_cluster.cc:1428] Setting key b1deb78af8b2a8fbd32f0c5e65b97791
Sep 29 06:37:32 dist-test-slave-601b krb5kdc[27475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663852, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:32.776099 27579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.767606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:52159 (local address 127.9.61.126:41585)
0929 06:37:32.767660 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:32.767662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:32.767901 (+ 239us) server_negotiation.cc:407] Connection header received
0929 06:37:32.768420 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:32.768421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:32.768433 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:32.768489 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:32.769520 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.770008 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.770999 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.771174 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.771225 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.773529 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:32.773530 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:32.773531 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:32.773537 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:32.774955 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:32.775298 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:32.775298 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:32.775299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:32.775347 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:32.775548 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:32.775549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:32.775549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:32.775647 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:32.775695 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:32.775915 (+ 220us) server_negotiation.cc:299] Negotiation successful
0929 06:37:32.776038 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:37:32.776383 27981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.767600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41585 (local address 127.9.61.67:52159)
0929 06:37:32.767767 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:32.767802 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:32.768334 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:32.768563 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:32.768567 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:32.769235 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:32.769434 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.769439 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.770097 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.770097 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.770918 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.770920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.771246 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.771246 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.771344 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.771900 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:37:32.771911 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:32.773447 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:32.775029 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:32.775034 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:32.775036 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:32.775236 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:32.775405 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:32.775405 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:32.775406 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:32.775495 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:32.775700 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:32.775704 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:32.775811 (+ 107us) client_negotiation.cc:769] Sending connection context
0929 06:37:32.775890 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:37:32.776078 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":89,"threads_started":1}
I20260929 06:37:32.776916 27979 heartbeater.cc:347] Connected to a master server at 127.9.61.126:41585
I20260929 06:37:32.777011 27979 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:32.777204 27979 heartbeater.cc:511] Master 127.9.61.126:41585 requested a full tablet report, sending...
I20260929 06:37:32.777583 27520 ts_manager.cc:194] Registered new tserver with Master: 00a7dcd7c3234762af80629bd0ad7c1d (127.9.61.67:38143)
I20260929 06:37:32.777990 27520 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:52159
I20260929 06:37:32.783879 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:37:32.791330 27579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.785246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52462 (local address 127.9.61.126:41585)
0929 06:37:32.785328 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:32.785331 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:32.785422 (+ 91us) server_negotiation.cc:407] Connection header received
0929 06:37:32.785535 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:32.785536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:32.785547 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:32.785598 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:32.786147 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.786635 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.787403 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.787601 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.787678 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.788999 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:32.789009 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:32.789010 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:32.789017 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:32.790105 (+ 1088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:32.790499 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:32.790501 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:32.790501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:32.790564 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:32.790785 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:32.790786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:32.790786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:32.790931 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:32.791044 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:32.791167 (+ 123us) server_negotiation.cc:299] Negotiation successful
0929 06:37:32.791231 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260929 06:37:32.792925 27520 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52462:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:37:32.794520 27520 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:37:32.801554 27995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.797535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50044 (local address 127.9.61.65:44189)
0929 06:37:32.797886 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:32.797890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:32.797900 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:37:32.797941 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:32.797943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:32.797964 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:32.798051 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:32.798169 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.798852 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.800277 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.801072 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.801167 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.801244 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:32.801407 (+ 163us) server_negotiation.cc:299] Negotiation successful
0929 06:37:32.801454 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":83,"threads_started":1}
I20260929 06:37:32.801549 27993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.797063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:44189 (local address 127.0.0.1:50044)
0929 06:37:32.797712 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:32.797722 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:32.797765 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:32.798061 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:32.798062 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:32.798065 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:32.798113 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.798116 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.798962 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.798963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.800188 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.800192 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.801173 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.801174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.801274 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.801292 (+ 18us) client_negotiation.cc:769] Sending connection context
0929 06:37:32.801379 (+ 87us) client_negotiation.cc:240] Negotiation successful
0929 06:37:32.801453 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"mutex_wait_us":36,"thread_start_us":69,"threads_started":1}
I20260929 06:37:32.801577 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.796964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35362 (local address 127.9.61.67:38143)
0929 06:37:32.797160 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:32.797166 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:32.797181 (+ 15us) server_negotiation.cc:407] Connection header received
0929 06:37:32.797227 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:32.797229 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:32.797246 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:32.797329 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:32.797722 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.798847 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.800470 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.801191 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.801261 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.801308 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:32.801439 (+ 131us) server_negotiation.cc:299] Negotiation successful
0929 06:37:32.801482 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":121,"threads_started":1}
I20260929 06:37:32.802227 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.796856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:38143 (local address 127.0.0.1:35362)
0929 06:37:32.797024 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:32.797068 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:32.797137 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:32.797356 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:32.797359 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:32.797362 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:32.797440 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.797442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.799007 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.799008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.800384 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.800385 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.801275 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.801276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.801332 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.801335 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:32.801388 (+ 53us) client_negotiation.cc:240] Negotiation successful
0929 06:37:32.802129 (+ 741us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":782,"thread_start_us":54,"threads_started":1}
I20260929 06:37:32.802537 27994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.797221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54752 (local address 127.9.61.66:37705)
0929 06:37:32.797410 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:32.797414 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:32.797423 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:37:32.797457 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:32.797459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:32.797479 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:32.797577 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:32.797689 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.798848 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.801380 (+ 2532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.802157 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.802226 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.802280 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:32.802411 (+ 131us) server_negotiation.cc:299] Negotiation successful
0929 06:37:32.802452 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":105,"threads_started":1}
I20260929 06:37:32.802493 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.796860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:37705 (local address 127.0.0.1:54752)
0929 06:37:32.797177 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:32.797188 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:32.797245 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:32.797574 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:32.797575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:32.797578 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:32.797625 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.797626 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.798982 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.799000 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.800369 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.800372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.802241 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.802242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.802313 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.802320 (+ 7us) client_negotiation.cc:769] Sending connection context
0929 06:37:32.802391 (+ 71us) client_negotiation.cc:240] Negotiation successful
0929 06:37:32.802430 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":88,"thread_start_us":97,"threads_started":1}
I20260929 06:37:32.802541 27645 tablet_service.cc:1467] Processing CreateTablet for tablet a78ca3c46d7e40b3b48abd0fcb03bac7 (DEFAULT_TABLE table=test-table [id=de74e04c1b0841a1973b98cc187f4f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:32.802937 27645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78ca3c46d7e40b3b48abd0fcb03bac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:32.804739 27779 tablet_service.cc:1467] Processing CreateTablet for tablet a78ca3c46d7e40b3b48abd0fcb03bac7 (DEFAULT_TABLE table=test-table [id=de74e04c1b0841a1973b98cc187f4f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:32.804909 27913 tablet_service.cc:1467] Processing CreateTablet for tablet a78ca3c46d7e40b3b48abd0fcb03bac7 (DEFAULT_TABLE table=test-table [id=de74e04c1b0841a1973b98cc187f4f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:32.805140 27779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78ca3c46d7e40b3b48abd0fcb03bac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:32.805263 27913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78ca3c46d7e40b3b48abd0fcb03bac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:32.806365 27996 tablet_bootstrap.cc:492] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c: Bootstrap starting.
I20260929 06:37:32.807176 27996 tablet_bootstrap.cc:654] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:32.807821 27996 log.cc:824] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:32.808717 27996 tablet_bootstrap.cc:492] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c: No bootstrap required, opened a new log
I20260929 06:37:32.808700 27999 tablet_bootstrap.cc:492] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154: Bootstrap starting.
I20260929 06:37:32.808773 27996 ts_tablet_manager.cc:1397] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:37:32.809350 27999 tablet_bootstrap.cc:654] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:32.809928 27999 log.cc:824] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:32.810629 27999 tablet_bootstrap.cc:492] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154: No bootstrap required, opened a new log
I20260929 06:37:32.810684 27999 ts_tablet_manager.cc:1397] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:37:32.810532 27996 raft_consensus.cc:348] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fb48c2aab94889a2475f6b30fd1154" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37705 } } peers { permanent_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38143 } } peers { permanent_uuid: "69ea7e7d631940f7b73675ea6e6d294c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44189 } }
I20260929 06:37:32.810714 27996 raft_consensus.cc:374] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:32.810760 27996 raft_consensus.cc:729] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ea7e7d631940f7b73675ea6e6d294c, State: Initialized, Role: FOLLOWER
I20260929 06:37:32.810892 27996 consensus_queue.cc:260] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fb48c2aab94889a2475f6b30fd1154" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37705 } } peers { permanent_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38143 } } peers { permanent_uuid: "69ea7e7d631940f7b73675ea6e6d294c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44189 } }
I20260929 06:37:32.811206 27996 ts_tablet_manager.cc:1428] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:37:32.811240 27711 heartbeater.cc:503] Master 127.9.61.126:41585 was elected leader, sending a full tablet report...
I20260929 06:37:32.811347 27998 tablet_bootstrap.cc:492] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d: Bootstrap starting.
I20260929 06:37:32.812125 27998 tablet_bootstrap.cc:654] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:32.812779 27998 log.cc:824] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:32.812704 27999 raft_consensus.cc:348] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fb48c2aab94889a2475f6b30fd1154" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37705 } } peers { permanent_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38143 } } peers { permanent_uuid: "69ea7e7d631940f7b73675ea6e6d294c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44189 } }
I20260929 06:37:32.812906 27999 raft_consensus.cc:374] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:32.812959 27999 raft_consensus.cc:729] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39fb48c2aab94889a2475f6b30fd1154, State: Initialized, Role: FOLLOWER
I20260929 06:37:32.813103 27999 consensus_queue.cc:260] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fb48c2aab94889a2475f6b30fd1154" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37705 } } peers { permanent_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38143 } } peers { permanent_uuid: "69ea7e7d631940f7b73675ea6e6d294c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44189 } }
I20260929 06:37:32.813416 27999 ts_tablet_manager.cc:1428] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:37:32.813447 27845 heartbeater.cc:503] Master 127.9.61.126:41585 was elected leader, sending a full tablet report...
I20260929 06:37:32.813659 27998 tablet_bootstrap.cc:492] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d: No bootstrap required, opened a new log
I20260929 06:37:32.813730 27998 ts_tablet_manager.cc:1397] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260929 06:37:32.815363 27998 raft_consensus.cc:348] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fb48c2aab94889a2475f6b30fd1154" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37705 } } peers { permanent_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38143 } } peers { permanent_uuid: "69ea7e7d631940f7b73675ea6e6d294c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44189 } }
I20260929 06:37:32.815505 27998 raft_consensus.cc:374] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:32.815526 27998 raft_consensus.cc:729] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00a7dcd7c3234762af80629bd0ad7c1d, State: Initialized, Role: FOLLOWER
I20260929 06:37:32.815659 27998 consensus_queue.cc:260] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fb48c2aab94889a2475f6b30fd1154" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37705 } } peers { permanent_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38143 } } peers { permanent_uuid: "69ea7e7d631940f7b73675ea6e6d294c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44189 } }
I20260929 06:37:32.815989 27998 ts_tablet_manager.cc:1428] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:37:32.816008 27979 heartbeater.cc:503] Master 127.9.61.126:41585 was elected leader, sending a full tablet report...
W20260929 06:37:32.844985 27846 tablet.cc:2369] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:37:32.870213 28004 raft_consensus.cc:482] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:37:32.870340 28004 raft_consensus.cc:504] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fb48c2aab94889a2475f6b30fd1154" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37705 } } peers { permanent_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38143 } } peers { permanent_uuid: "69ea7e7d631940f7b73675ea6e6d294c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44189 } }
I20260929 06:37:32.870739 28004 leader_election.cc:288] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39fb48c2aab94889a2475f6b30fd1154 (127.9.61.66:37705), 69ea7e7d631940f7b73675ea6e6d294c (127.9.61.65:44189)
I20260929 06:37:32.873674 27994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.871066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:49187 (local address 127.9.61.66:37705)
0929 06:37:32.871137 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:32.871139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:32.871152 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:37:32.871222 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:32.871223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:32.871237 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:32.871295 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:32.871457 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.871924 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.872915 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.873301 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.873389 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.873400 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:32.873564 (+ 164us) server_negotiation.cc:299] Negotiation successful
0929 06:37:32.873604 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260929 06:37:32.873674 27981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.870979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:37705 (local address 127.9.61.67:49187)
0929 06:37:32.871067 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:32.871081 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:32.871151 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:32.871302 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:32.871303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:32.871305 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:32.871377 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.871378 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.872064 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.872065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.872817 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.872819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.873388 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.873389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.873473 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.873476 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:32.873558 (+ 82us) client_negotiation.cc:240] Negotiation successful
0929 06:37:32.873602 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260929 06:37:32.873960 27995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.871205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:54435 (local address 127.9.61.65:44189)
0929 06:37:32.871252 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:32.871254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:32.871358 (+ 104us) server_negotiation.cc:407] Connection header received
0929 06:37:32.871406 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:32.871407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:32.871418 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:32.871512 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:32.871680 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.872263 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.873175 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.873569 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.873655 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.873665 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:32.873841 (+ 176us) server_negotiation.cc:299] Negotiation successful
0929 06:37:32.873894 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:37:32.873955 28005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.871125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:44189 (local address 127.9.61.67:54435)
0929 06:37:32.871287 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:32.871295 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:32.871351 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:32.871523 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:32.871523 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:32.871525 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:32.871599 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.871601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.872342 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.872343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.873080 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:32.873082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.873657 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.873658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:32.873728 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.873732 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:37:32.873823 (+ 91us) client_negotiation.cc:240] Negotiation successful
0929 06:37:32.873872 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":113,"threads_started":1}
I20260929 06:37:32.874019 27799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78ca3c46d7e40b3b48abd0fcb03bac7" candidate_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39fb48c2aab94889a2475f6b30fd1154" is_pre_election: true
I20260929 06:37:32.874186 27799 raft_consensus.cc:2454] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00a7dcd7c3234762af80629bd0ad7c1d in term 0.
I20260929 06:37:32.874442 27868 leader_election.cc:302] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00a7dcd7c3234762af80629bd0ad7c1d, 39fb48c2aab94889a2475f6b30fd1154; no voters:
I20260929 06:37:32.874619 28004 raft_consensus.cc:2781] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:37:32.874598 27665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78ca3c46d7e40b3b48abd0fcb03bac7" candidate_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ea7e7d631940f7b73675ea6e6d294c" is_pre_election: true
I20260929 06:37:32.874678 28004 raft_consensus.cc:482] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:37:32.874702 28004 raft_consensus.cc:3037] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:32.874749 27665 raft_consensus.cc:2454] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00a7dcd7c3234762af80629bd0ad7c1d in term 0.
I20260929 06:37:32.875471 28004 raft_consensus.cc:504] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fb48c2aab94889a2475f6b30fd1154" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37705 } } peers { permanent_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38143 } } peers { permanent_uuid: "69ea7e7d631940f7b73675ea6e6d294c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44189 } }
I20260929 06:37:32.875614 28004 leader_election.cc:288] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [CANDIDATE]: Term 1 election: Requested vote from peers 39fb48c2aab94889a2475f6b30fd1154 (127.9.61.66:37705), 69ea7e7d631940f7b73675ea6e6d294c (127.9.61.65:44189)
I20260929 06:37:32.875787 27799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78ca3c46d7e40b3b48abd0fcb03bac7" candidate_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39fb48c2aab94889a2475f6b30fd1154"
I20260929 06:37:32.875849 27799 raft_consensus.cc:3037] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:32.875808 27665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78ca3c46d7e40b3b48abd0fcb03bac7" candidate_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ea7e7d631940f7b73675ea6e6d294c"
I20260929 06:37:32.875954 27665 raft_consensus.cc:3037] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:32.876633 27799 raft_consensus.cc:2454] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00a7dcd7c3234762af80629bd0ad7c1d in term 1.
I20260929 06:37:32.876761 27665 raft_consensus.cc:2454] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00a7dcd7c3234762af80629bd0ad7c1d in term 1.
I20260929 06:37:32.876799 27868 leader_election.cc:302] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00a7dcd7c3234762af80629bd0ad7c1d, 39fb48c2aab94889a2475f6b30fd1154; no voters:
I20260929 06:37:32.876976 28004 raft_consensus.cc:2781] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:32.877148 28004 raft_consensus.cc:686] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 1 LEADER]: Becoming Leader. State: Replica: 00a7dcd7c3234762af80629bd0ad7c1d, State: Running, Role: LEADER
I20260929 06:37:32.877244 28004 consensus_queue.cc:237] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fb48c2aab94889a2475f6b30fd1154" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37705 } } peers { permanent_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38143 } } peers { permanent_uuid: "69ea7e7d631940f7b73675ea6e6d294c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44189 } }
I20260929 06:37:32.878123 27520 catalog_manager.cc:5495] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 00a7dcd7c3234762af80629bd0ad7c1d (127.9.61.67). New cstate: current_term: 1 leader_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fb48c2aab94889a2475f6b30fd1154" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00a7dcd7c3234762af80629bd0ad7c1d" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 38143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ea7e7d631940f7b73675ea6e6d294c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44189 } health_report { overall_health: UNKNOWN } } }
I20260929 06:37:32.898149 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.895558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35366 (local address 127.9.61.67:38143)
0929 06:37:32.895627 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:32.895630 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:32.895638 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:37:32.895682 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:32.895683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:32.895704 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:32.895787 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:37:32.895946 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.896458 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.897359 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:32.897563 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:32.897641 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:32.897785 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:37:32.897882 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:37:32.897997 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:32.898028 (+ 31us) server_negotiation.cc:299] Negotiation successful
0929 06:37:32.898036 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260929 06:37:32.900089 27799 raft_consensus.cc:1261] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154 [term 1 FOLLOWER]: Refusing update from remote peer 00a7dcd7c3234762af80629bd0ad7c1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:37:32.900090 27665 raft_consensus.cc:1261] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c [term 1 FOLLOWER]: Refusing update from remote peer 00a7dcd7c3234762af80629bd0ad7c1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:37:32.900476 28004 consensus_queue.cc:1035] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "39fb48c2aab94889a2475f6b30fd1154" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:37:32.900640 28006 consensus_queue.cc:1035] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ea7e7d631940f7b73675ea6e6d294c" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 44189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:37:32.903527 28011 mvcc.cc:205] Tried to move back new op lower bound from 7334559141475635200 to 7334559141386027008. Current Snapshot: MvccSnapshot[applied={T|T < 7334559141475635200 or (T in {7334559141475635200})}]
I20260929 06:37:32.905325 27519 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52462:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:37:32.905438 27519 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52462:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:37:32.906211 27519 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a47bfad0cf24791897c50b90abc5a21: Sending DeleteTablet for 3 replicas of tablet a78ca3c46d7e40b3b48abd0fcb03bac7
I20260929 06:37:32.906533 27779 tablet_service.cc:1514] Processing DeleteTablet for tablet a78ca3c46d7e40b3b48abd0fcb03bac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:32 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:54752
I20260929 06:37:32.906595 27645 tablet_service.cc:1514] Processing DeleteTablet for tablet a78ca3c46d7e40b3b48abd0fcb03bac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:32 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:50044
I20260929 06:37:32.906831 28020 tablet_replica.cc:330] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c: stopping tablet replica
I20260929 06:37:32.906834 28019 tablet_replica.cc:330] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154: stopping tablet replica
I20260929 06:37:32.906898 27913 tablet_service.cc:1514] Processing DeleteTablet for tablet a78ca3c46d7e40b3b48abd0fcb03bac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:32 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:35362
I20260929 06:37:32.906936 28020 raft_consensus.cc:2229] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:37:32.907032 28019 raft_consensus.cc:2229] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:37:32.907044 28020 raft_consensus.cc:2258] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 69ea7e7d631940f7b73675ea6e6d294c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:32.907275 28019 raft_consensus.cc:2258] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:32.907385 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 27582
I20260929 06:37:32.909366 28021 tablet_replica.cc:330] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d: stopping tablet replica
I20260929 06:37:32.909476 28021 raft_consensus.cc:2229] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:37:32.909579 28021 raft_consensus.cc:2258] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:32.910012 28021 ts_tablet_manager.cc:1905] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:37:32.911680 28021 ts_tablet_manager.cc:1918] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:37:32.911757 28021 log.cc:1196] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/a78ca3c46d7e40b3b48abd0fcb03bac7
I20260929 06:37:32.912098 28021 ts_tablet_manager.cc:1939] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 00a7dcd7c3234762af80629bd0ad7c1d: Deleting consensus metadata
I20260929 06:37:32.912533 27504 catalog_manager.cc:4841] TS 00a7dcd7c3234762af80629bd0ad7c1d (127.9.61.67:38143): tablet a78ca3c46d7e40b3b48abd0fcb03bac7 (table test-table [id=de74e04c1b0841a1973b98cc187f4f99]) successfully deleted
W20260929 06:37:32.913280 27506 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:44189 (error 108)
I20260929 06:37:32.913635 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 27716
I20260929 06:37:32.913812 28019 ts_tablet_manager.cc:1905] T a78ca3c46d7e40b3b48abd0fcb03bac7 P 39fb48c2aab94889a2475f6b30fd1154: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:37:32.920629 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.920461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:44189 (local address 127.0.0.1:50046)
0929 06:37:32.920517 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:32.920577 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:44189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260929 06:37:32.920823 27506 catalog_manager.cc:4584] TS 69ea7e7d631940f7b73675ea6e6d294c (127.9.61.65:44189): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a78ca3c46d7e40b3b48abd0fcb03bac7: Network error: Client connection negotiation failed: client connection to 127.9.61.65:44189: connect: Connection refused (error 111)
I20260929 06:37:32.921113 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:32.920723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:37705 (local address 127.0.0.1:54764)
0929 06:37:32.921059 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:32.921089 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.66:37705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314}
I20260929 06:37:32.921106 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 27850
I20260929 06:37:32.926263 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 27488
2026-09-29T06:37:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (1975 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-29T06:37:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:32Z Disabled control of system clock
I20260929 06:37:32.954769 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:38997
--webserver_interface=127.9.61.126
--webserver_port=0
--builtin_ntp_servers=127.9.61.84:46737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:38997
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:37:33.037928 28026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:33.038166 28026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:33.038188 28026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:33.039280 28026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:33.039315 28026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:33.039327 28026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:33.039340 28026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:33.039352 28026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:33.040664 28026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:38997
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:38997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:33.040874 28026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:33.041146 28026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:33.046123 28032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:33.046114 28031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:33.046114 28034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:33.046381 28026 server_base.cc:1034] running on GCE node
I20260929 06:37:33.046695 28026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:33.046989 28026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:33.048152 28026 hybrid_clock.cc:648] HybridClock initialized: now 1790663853048145 us; error 32 us; skew 500 ppm
I20260929 06:37:33.049459 28026 webserver.cc:460] Webserver started at http://127.9.61.126:33843/ using document root <none> and password file <none>
I20260929 06:37:33.049729 28026 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:33.049803 28026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:33.049954 28026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:33.051044 28026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "afc7ed78492542b498c7783366bf577c"
format_stamp: "Formatted at 2026-09-29 06:37:33 on dist-test-slave-601b"
server_key: "1440380a1bee42c98aede2d74daa7bd7"
server_key_iv: "89b111e3c6d819cbcf0a01b5108a4d99"
server_key_version: "encryptionkey@0"
I20260929 06:37:33.051425 28026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "afc7ed78492542b498c7783366bf577c"
format_stamp: "Formatted at 2026-09-29 06:37:33 on dist-test-slave-601b"
server_key: "1440380a1bee42c98aede2d74daa7bd7"
server_key_iv: "89b111e3c6d819cbcf0a01b5108a4d99"
server_key_version: "encryptionkey@0"
I20260929 06:37:33.052771 28026 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:37:33.053483 28040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:33.053670 28026 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:37:33.053776 28026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "afc7ed78492542b498c7783366bf577c"
format_stamp: "Formatted at 2026-09-29 06:37:33 on dist-test-slave-601b"
server_key: "1440380a1bee42c98aede2d74daa7bd7"
server_key_iv: "89b111e3c6d819cbcf0a01b5108a4d99"
server_key_version: "encryptionkey@0"
I20260929 06:37:33.053850 28026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:33.067543 28026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:33.067914 28026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:33.068104 28026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:33.072098 28026 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:38997
I20260929 06:37:33.072154 28092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:38997 every 8 connection(s)
I20260929 06:37:33.072530 28026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:33.073580 28093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:33.075887 28093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c: Bootstrap starting.
I20260929 06:37:33.076510 28093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:33.076822 28093 log.cc:824] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:33.077574 28093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c: No bootstrap required, opened a new log
I20260929 06:37:33.079110 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 28026
I20260929 06:37:33.079237 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:33.079244 28093 raft_consensus.cc:348] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc7ed78492542b498c7783366bf577c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38997 } }
I20260929 06:37:33.079419 28093 raft_consensus.cc:374] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:33.079452 9461 external_mini_cluster.cc:1428] Setting key 3e6a122031c468e3a0c7c8fd678051fd
I20260929 06:37:33.079445 28093 raft_consensus.cc:729] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afc7ed78492542b498c7783366bf577c, State: Initialized, Role: FOLLOWER
I20260929 06:37:33.079651 28093 consensus_queue.cc:260] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc7ed78492542b498c7783366bf577c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38997 } }
I20260929 06:37:33.079756 28093 raft_consensus.cc:388] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:33.079794 28093 raft_consensus.cc:482] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:33.079861 28093 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:33.080600 28093 raft_consensus.cc:504] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc7ed78492542b498c7783366bf577c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38997 } }
I20260929 06:37:33.080719 28093 leader_election.cc:302] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afc7ed78492542b498c7783366bf577c; no voters:
I20260929 06:37:33.080909 28093 leader_election.cc:288] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:33.080974 28098 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:33.081117 28098 raft_consensus.cc:686] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [term 1 LEADER]: Becoming Leader. State: Replica: afc7ed78492542b498c7783366bf577c, State: Running, Role: LEADER
I20260929 06:37:33.081198 28093 sys_catalog.cc:564] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:33.081259 28098 consensus_queue.cc:237] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc7ed78492542b498c7783366bf577c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38997 } }
I20260929 06:37:33.081663 28098 sys_catalog.cc:455] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [sys.catalog]: SysCatalogTable state changed. Reason: New leader afc7ed78492542b498c7783366bf577c. Latest consensus state: current_term: 1 leader_uuid: "afc7ed78492542b498c7783366bf577c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc7ed78492542b498c7783366bf577c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38997 } } }
I20260929 06:37:33.081671 28100 sys_catalog.cc:455] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afc7ed78492542b498c7783366bf577c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc7ed78492542b498c7783366bf577c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38997 } } }
I20260929 06:37:33.081826 28098 sys_catalog.cc:458] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:33.081835 28100 sys_catalog.cc:458] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:33.082068 28107 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:33.082785 28107 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:33.084416 28107 catalog_manager.cc:1347] Generated new cluster ID: 232e29cee4e64db9871f0850bef2d3c6
I20260929 06:37:33.084465 28107 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:33.085860 28097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.079979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50282 (local address 127.9.61.126:38997)
0929 06:37:33.080211 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:33.080218 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:33.080242 (+ 24us) server_negotiation.cc:407] Connection header received
0929 06:37:33.080343 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:33.080348 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:33.080409 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:33.080520 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:33.080796 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.082642 (+ 1846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.083649 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.084256 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.084397 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.085176 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:33.085180 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:33.085181 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:33.085365 (+ 184us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:33.085399 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:33.085410 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:33.085485 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:33.085566 (+ 81us) server_negotiation.cc:299] Negotiation successful
0929 06:37:33.085647 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":106,"threads_started":1}
I20260929 06:37:33.099278 28107 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:33.100067 28107 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:33.111845 28107 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c: Generated new TSK 0
I20260929 06:37:33.112135 28107 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:33.113731 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38997
--builtin_ntp_servers=127.9.61.84:46737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:37:33.198716 28117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:33.198969 28117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:33.199009 28117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:33.200268 28117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:33.200328 28117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:33.200369 28117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:37:33.201756 28117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:33.202026 28117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:33.202332 28117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260929 06:37:33.208218 28117 server_base.cc:1034] running on GCE node
W20260929 06:37:33.208361 28122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:33.208177 28123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:33.208182 28125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:33.208722 28117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:33.209244 28117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:33.210426 28117 hybrid_clock.cc:648] HybridClock initialized: now 1790663853210409 us; error 35 us; skew 500 ppm
I20260929 06:37:33.211704 28117 webserver.cc:460] Webserver started at http://127.9.61.65:43241/ using document root <none> and password file <none>
I20260929 06:37:33.212025 28117 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:33.212100 28117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:33.212262 28117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:33.213338 28117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "4a2e303c5a79405583f87070f3cf504b"
format_stamp: "Formatted at 2026-09-29 06:37:33 on dist-test-slave-601b"
server_key: "cdbfd91f5e4a088c38aaf6d45157db09"
server_key_iv: "2e123a45e2a3519aa0174ea763b7f44f"
server_key_version: "encryptionkey@0"
I20260929 06:37:33.213703 28117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "4a2e303c5a79405583f87070f3cf504b"
format_stamp: "Formatted at 2026-09-29 06:37:33 on dist-test-slave-601b"
server_key: "cdbfd91f5e4a088c38aaf6d45157db09"
server_key_iv: "2e123a45e2a3519aa0174ea763b7f44f"
server_key_version: "encryptionkey@0"
I20260929 06:37:33.215067 28117 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:37:33.215823 28131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:33.216013 28117 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:37:33.216112 28117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "4a2e303c5a79405583f87070f3cf504b"
format_stamp: "Formatted at 2026-09-29 06:37:33 on dist-test-slave-601b"
server_key: "cdbfd91f5e4a088c38aaf6d45157db09"
server_key_iv: "2e123a45e2a3519aa0174ea763b7f44f"
server_key_version: "encryptionkey@0"
I20260929 06:37:33.216199 28117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:33.243597 28117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:33.243997 28117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:33.244169 28117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:33.244408 28117 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:33.244748 28117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:33.244782 28117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:33.244805 28117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:33.244850 28117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:33.250491 28117 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:43783
I20260929 06:37:33.250535 28244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:43783 every 8 connection(s)
I20260929 06:37:33.250885 28117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:37:33.256376 28097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.251709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:44865 (local address 127.9.61.126:38997)
0929 06:37:33.251800 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:33.251802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:33.252059 (+ 257us) server_negotiation.cc:407] Connection header received
0929 06:37:33.252588 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:33.252589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:33.252604 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:33.252652 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:33.253361 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.253872 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.254865 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.255076 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.255148 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.256070 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:33.256071 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:33.256072 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:33.256079 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:33.256097 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:33.256106 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:33.256171 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:33.256266 (+ 95us) server_negotiation.cc:299] Negotiation successful
0929 06:37:33.256299 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260929 06:37:33.256590 28247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.251667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38997 (local address 127.9.61.65:44865)
0929 06:37:33.251890 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:33.251924 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:33.252484 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:33.252741 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:33.252750 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:33.252759 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:33.253268 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.253273 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.253977 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.253978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.254762 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.254764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.255167 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.255168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.255296 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.255856 (+ 560us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:37:33.255857 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:33.255885 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:37:33.255907 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:33.256169 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:33.256176 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:33.256179 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:33.256268 (+ 89us) client_negotiation.cc:240] Negotiation successful
0929 06:37:33.256367 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":82,"threads_started":1}
I20260929 06:37:33.257009 28245 heartbeater.cc:347] Connected to a master server at 127.9.61.126:38997
I20260929 06:37:33.257122 28245 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:33.257295 28245 heartbeater.cc:511] Master 127.9.61.126:38997 requested a full tablet report, sending...
I20260929 06:37:33.257823 28057 ts_manager.cc:194] Registered new tserver with Master: 4a2e303c5a79405583f87070f3cf504b (127.9.61.65:43783)
I20260929 06:37:33.258409 28057 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.61.65:44865
I20260929 06:37:33.259614 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 28117
I20260929 06:37:33.259747 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:37:33.259929 9461 external_mini_cluster.cc:1428] Setting key e795f335746022a61280dcfe7b7df123
I20260929 06:37:33.260794 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38997
--builtin_ntp_servers=127.9.61.84:46737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:37:33.340428 28248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:33.340634 28248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:33.340655 28248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:33.341827 28248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:33.341866 28248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:33.341919 28248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:37:33.343220 28248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:33.343452 28248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:33.343740 28248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:33.348635 28253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:33.348691 28254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:33.348644 28256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:33.348860 28248 server_base.cc:1034] running on GCE node
I20260929 06:37:33.349081 28248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:33.349270 28248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:33.350433 28248 hybrid_clock.cc:648] HybridClock initialized: now 1790663853350420 us; error 25 us; skew 500 ppm
I20260929 06:37:33.351715 28248 webserver.cc:460] Webserver started at http://127.9.61.66:42561/ using document root <none> and password file <none>
I20260929 06:37:33.352022 28248 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:33.352095 28248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:33.352239 28248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:33.353281 28248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4"
format_stamp: "Formatted at 2026-09-29 06:37:33 on dist-test-slave-601b"
server_key: "9da04aa57c8611206879eadd17480855"
server_key_iv: "7160830f663a895e51e084ffa21699c9"
server_key_version: "encryptionkey@0"
I20260929 06:37:33.353643 28248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4"
format_stamp: "Formatted at 2026-09-29 06:37:33 on dist-test-slave-601b"
server_key: "9da04aa57c8611206879eadd17480855"
server_key_iv: "7160830f663a895e51e084ffa21699c9"
server_key_version: "encryptionkey@0"
I20260929 06:37:33.354952 28248 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:37:33.355670 28262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:33.355834 28248 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:37:33.355929 28248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4"
format_stamp: "Formatted at 2026-09-29 06:37:33 on dist-test-slave-601b"
server_key: "9da04aa57c8611206879eadd17480855"
server_key_iv: "7160830f663a895e51e084ffa21699c9"
server_key_version: "encryptionkey@0"
I20260929 06:37:33.356060 28248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:33.389195 28248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:33.389540 28248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:33.389708 28248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:33.389951 28248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:33.390293 28248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:33.390328 28248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:33.390372 28248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:33.390399 28248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:33.396255 28248 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:38111
I20260929 06:37:33.396329 28375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:38111 every 8 connection(s)
I20260929 06:37:33.396685 28248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:37:33.401659 28097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.397421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:41417 (local address 127.9.61.126:38997)
0929 06:37:33.397501 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:33.397503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:33.397740 (+ 237us) server_negotiation.cc:407] Connection header received
0929 06:37:33.398214 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:33.398215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:33.398224 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:33.398274 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:33.398909 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.399390 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.400413 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.400607 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.400674 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.401423 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:33.401424 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:33.401425 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:33.401428 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:33.401442 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:33.401445 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:33.401491 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:33.401574 (+ 83us) server_negotiation.cc:299] Negotiation successful
0929 06:37:33.401597 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 06:37:33.401849 28378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.397415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38997 (local address 127.9.61.66:41417)
0929 06:37:33.397619 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:33.397653 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:33.398131 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:33.398336 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:33.398339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:33.398346 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:33.398841 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.398846 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.399469 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.399469 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.400333 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.400336 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.400687 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.400688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.400797 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.401296 (+ 499us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:37:33.401297 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:33.401324 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:37:33.401346 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:33.401507 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:33.401511 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:33.401513 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:37:33.401563 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 06:37:33.401645 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":102,"threads_started":1}
I20260929 06:37:33.402397 28376 heartbeater.cc:347] Connected to a master server at 127.9.61.126:38997
I20260929 06:37:33.402495 28376 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:33.402643 28376 heartbeater.cc:511] Master 127.9.61.126:38997 requested a full tablet report, sending...
I20260929 06:37:33.403012 28057 ts_manager.cc:194] Registered new tserver with Master: bb29bfa9f6294c6b9a3bf1f50bb655c4 (127.9.61.66:38111)
I20260929 06:37:33.403340 28057 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.61.66:41417
I20260929 06:37:33.405866 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 28248
I20260929 06:37:33.405946 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:37:33.406087 9461 external_mini_cluster.cc:1428] Setting key b78a608f56ac3b0a4253c0f73d62227f
I20260929 06:37:33.406905 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38997
--builtin_ntp_servers=127.9.61.84:46737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:37:33.486881 28379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:33.487107 28379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:33.487161 28379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:33.488293 28379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:33.488365 28379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:33.488404 28379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:37:33.489751 28379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:46737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:33.490005 28379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:33.490293 28379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:33.494999 28387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:33.495143 28385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:33.495177 28384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:33.495515 28379 server_base.cc:1034] running on GCE node
I20260929 06:37:33.495743 28379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:33.496017 28379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:33.497179 28379 hybrid_clock.cc:648] HybridClock initialized: now 1790663853497158 us; error 32 us; skew 500 ppm
I20260929 06:37:33.498396 28379 webserver.cc:460] Webserver started at http://127.9.61.67:39035/ using document root <none> and password file <none>
I20260929 06:37:33.498633 28379 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:33.498701 28379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:33.498858 28379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:33.499902 28379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "b6efcc8c54e04ceaa00ca9a85c936b65"
format_stamp: "Formatted at 2026-09-29 06:37:33 on dist-test-slave-601b"
server_key: "e537711a3eff0dc1e6086d28f7f80b43"
server_key_iv: "0dc23c83163f646658dcad496c7e02fc"
server_key_version: "encryptionkey@0"
I20260929 06:37:33.500371 28379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "b6efcc8c54e04ceaa00ca9a85c936b65"
format_stamp: "Formatted at 2026-09-29 06:37:33 on dist-test-slave-601b"
server_key: "e537711a3eff0dc1e6086d28f7f80b43"
server_key_iv: "0dc23c83163f646658dcad496c7e02fc"
server_key_version: "encryptionkey@0"
I20260929 06:37:33.501647 28379 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:33.502355 28393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:33.502537 28379 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:37:33.502636 28379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "b6efcc8c54e04ceaa00ca9a85c936b65"
format_stamp: "Formatted at 2026-09-29 06:37:33 on dist-test-slave-601b"
server_key: "e537711a3eff0dc1e6086d28f7f80b43"
server_key_iv: "0dc23c83163f646658dcad496c7e02fc"
server_key_version: "encryptionkey@0"
I20260929 06:37:33.502722 28379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:33.519657 28379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:33.519975 28379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:33.520133 28379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:33.520362 28379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:33.520696 28379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:33.520748 28379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:33.520782 28379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:33.520809 28379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:33.526180 28379 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:46041
I20260929 06:37:33.526221 28506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:46041 every 8 connection(s)
I20260929 06:37:33.526579 28379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:37:33.531333 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 28379
I20260929 06:37:33.531467 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:37:33.531553 28097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.527346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:56199 (local address 127.9.61.126:38997)
0929 06:37:33.527406 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:33.527408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:33.527616 (+ 208us) server_negotiation.cc:407] Connection header received
0929 06:37:33.528151 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:33.528152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:33.528162 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:33.528218 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:33.528842 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.529339 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.530251 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.530425 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.530476 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.531242 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:33.531244 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:33.531245 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:33.531251 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:33.531269 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:33.531274 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:33.531338 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:33.531418 (+ 80us) server_negotiation.cc:299] Negotiation successful
0929 06:37:33.531451 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260929 06:37:33.531692 9461 external_mini_cluster.cc:1428] Setting key cf1d5b3014d527ebcc224702ddd22169
I20260929 06:37:33.531762 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.527276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38997 (local address 127.9.61.67:56199)
0929 06:37:33.527484 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:33.527525 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:33.528069 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:33.528281 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:33.528284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:33.528292 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:33.528776 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.528780 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.529419 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.529419 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.530176 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.530178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.530506 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.530507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.530619 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.531105 (+ 486us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:37:33.531106 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:33.531133 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:37:33.531154 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:33.531343 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:33.531347 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:33.531350 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:33.531401 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 06:37:33.531521 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":101,"threads_started":1}
I20260929 06:37:33.532392 28507 heartbeater.cc:347] Connected to a master server at 127.9.61.126:38997
I20260929 06:37:33.532498 28507 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:33.532676 28507 heartbeater.cc:511] Master 127.9.61.126:38997 requested a full tablet report, sending...
I20260929 06:37:33.533042 28056 ts_manager.cc:194] Registered new tserver with Master: b6efcc8c54e04ceaa00ca9a85c936b65 (127.9.61.67:46041)
I20260929 06:37:33.533365 28056 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.61.67:56199
I20260929 06:37:33.543678 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:37:33.548046 28097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.545087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50292 (local address 127.9.61.126:38997)
0929 06:37:33.545162 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:33.545164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:33.545275 (+ 111us) server_negotiation.cc:407] Connection header received
0929 06:37:33.545350 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:33.545351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:33.545364 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:33.545408 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:33.545586 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.546057 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.546812 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.547001 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.547075 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.547732 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:33.547733 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:33.547733 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:33.547738 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:33.547751 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:33.547755 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:33.547865 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:33.547930 (+ 65us) server_negotiation.cc:299] Negotiation successful
0929 06:37:33.547963 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260929 06:37:33.549789 28056 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:37:33.551262 28056 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:37:33.557729 28517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.553370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43783 (local address 127.0.0.1:42822)
0929 06:37:33.553638 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:33.553679 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:33.553761 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:33.554278 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:33.554281 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:33.554284 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:33.554361 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.554364 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.555268 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.555269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.556417 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.556420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.557407 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.557408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.557490 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.557503 (+ 13us) client_negotiation.cc:769] Sending connection context
0929 06:37:33.557582 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:37:33.557634 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":1,"thread_start_us":53,"threads_started":1}
I20260929 06:37:33.557767 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.553467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42822 (local address 127.9.61.65:43783)
0929 06:37:33.553982 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:33.553987 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:33.553997 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:37:33.554032 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:33.554034 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:33.554047 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:33.554247 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:33.554426 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.555168 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.556506 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.557284 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.557404 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.557497 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:33.557597 (+ 100us) server_negotiation.cc:299] Negotiation successful
0929 06:37:33.557673 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":105,"threads_started":1}
I20260929 06:37:33.557919 28519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.553620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50148 (local address 127.9.61.67:46041)
0929 06:37:33.553786 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:33.553791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:33.553967 (+ 176us) server_negotiation.cc:407] Connection header received
0929 06:37:33.554024 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:33.554026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:33.554043 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:33.554124 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:33.554543 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.555630 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.556868 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.557388 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.557456 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.557541 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:33.557777 (+ 236us) server_negotiation.cc:299] Negotiation successful
0929 06:37:33.557819 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":76,"threads_started":1}
I20260929 06:37:33.558084 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.553385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:46041 (local address 127.0.0.1:50148)
0929 06:37:33.553860 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:33.553869 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:33.553920 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:33.554437 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:33.554438 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:33.554440 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:33.554479 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.554481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.555709 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.555710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.556779 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.556781 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.557573 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.557574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.557625 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.557628 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:33.557705 (+ 77us) client_negotiation.cc:240] Negotiation successful
0929 06:37:33.557736 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"mutex_wait_us":28,"thread_start_us":87,"threads_started":1}
I20260929 06:37:33.558295 28515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.553385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:38111 (local address 127.0.0.1:54934)
0929 06:37:33.553981 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:33.553988 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:33.554027 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:33.554278 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:33.554283 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:33.554286 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:33.554363 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.554365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.555715 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.555716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.556876 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.556878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.558070 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.558071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.558131 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.558136 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:37:33.558187 (+ 51us) client_negotiation.cc:240] Negotiation successful
0929 06:37:33.558228 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":35,"thread_start_us":90,"threads_started":1}
I20260929 06:37:33.558508 28520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.553786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54934 (local address 127.9.61.66:38111)
0929 06:37:33.553933 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:33.553938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:33.554027 (+ 89us) server_negotiation.cc:407] Connection header received
0929 06:37:33.554113 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:33.554115 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:33.554131 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:33.554210 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:33.554468 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.555610 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.556965 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.557709 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.557771 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.558032 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:33.558395 (+ 363us) server_negotiation.cc:299] Negotiation successful
0929 06:37:33.558431 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
I20260929 06:37:33.558633 28179 tablet_service.cc:1467] Processing CreateTablet for tablet 99877a7156d44fd4a241ce88dcd19350 (DEFAULT_TABLE table=test-table [id=b1dcb666783d46a6b37fac804fd4d400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:33.558758 28441 tablet_service.cc:1467] Processing CreateTablet for tablet 99877a7156d44fd4a241ce88dcd19350 (DEFAULT_TABLE table=test-table [id=b1dcb666783d46a6b37fac804fd4d400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:33.559010 28179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99877a7156d44fd4a241ce88dcd19350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:33.559120 28441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99877a7156d44fd4a241ce88dcd19350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:33.561692 28521 tablet_bootstrap.cc:492] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65: Bootstrap starting.
I20260929 06:37:33.561729 28522 tablet_bootstrap.cc:492] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b: Bootstrap starting.
I20260929 06:37:33.562353 28522 tablet_bootstrap.cc:654] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:33.562435 28521 tablet_bootstrap.cc:654] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:33.562547 28310 tablet_service.cc:1467] Processing CreateTablet for tablet 99877a7156d44fd4a241ce88dcd19350 (DEFAULT_TABLE table=test-table [id=b1dcb666783d46a6b37fac804fd4d400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:33.562676 28522 log.cc:824] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:33.562758 28521 log.cc:824] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:33.562896 28310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99877a7156d44fd4a241ce88dcd19350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:33.563383 28522 tablet_bootstrap.cc:492] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b: No bootstrap required, opened a new log
I20260929 06:37:33.563436 28522 ts_tablet_manager.cc:1397] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:37:33.564730 28521 tablet_bootstrap.cc:492] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65: No bootstrap required, opened a new log
I20260929 06:37:33.564807 28521 ts_tablet_manager.cc:1397] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 06:37:33.565487 28522 raft_consensus.cc:348] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a2e303c5a79405583f87070f3cf504b" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43783 } } peers { permanent_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 38111 } } peers { permanent_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 46041 } }
I20260929 06:37:33.565634 28522 raft_consensus.cc:374] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:33.565675 28522 raft_consensus.cc:729] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a2e303c5a79405583f87070f3cf504b, State: Initialized, Role: FOLLOWER
I20260929 06:37:33.565788 28522 consensus_queue.cc:260] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a2e303c5a79405583f87070f3cf504b" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43783 } } peers { permanent_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 38111 } } peers { permanent_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 46041 } }
I20260929 06:37:33.566035 28522 ts_tablet_manager.cc:1428] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:37:33.566179 28245 heartbeater.cc:503] Master 127.9.61.126:38997 was elected leader, sending a full tablet report...
I20260929 06:37:33.566264 28525 tablet_bootstrap.cc:492] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4: Bootstrap starting.
I20260929 06:37:33.566907 28525 tablet_bootstrap.cc:654] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:33.567216 28525 log.cc:824] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:33.567533 28521 raft_consensus.cc:348] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a2e303c5a79405583f87070f3cf504b" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43783 } } peers { permanent_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 38111 } } peers { permanent_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 46041 } }
I20260929 06:37:33.567711 28521 raft_consensus.cc:374] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:33.567762 28521 raft_consensus.cc:729] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6efcc8c54e04ceaa00ca9a85c936b65, State: Initialized, Role: FOLLOWER
I20260929 06:37:33.567890 28521 consensus_queue.cc:260] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a2e303c5a79405583f87070f3cf504b" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43783 } } peers { permanent_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 38111 } } peers { permanent_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 46041 } }
I20260929 06:37:33.568025 28525 tablet_bootstrap.cc:492] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4: No bootstrap required, opened a new log
I20260929 06:37:33.568104 28525 ts_tablet_manager.cc:1397] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:37:33.568162 28521 ts_tablet_manager.cc:1428] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260929 06:37:33.568216 28507 heartbeater.cc:503] Master 127.9.61.126:38997 was elected leader, sending a full tablet report...
I20260929 06:37:33.569984 28525 raft_consensus.cc:348] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a2e303c5a79405583f87070f3cf504b" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43783 } } peers { permanent_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 38111 } } peers { permanent_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 46041 } }
I20260929 06:37:33.570106 28525 raft_consensus.cc:374] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:33.570128 28525 raft_consensus.cc:729] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb29bfa9f6294c6b9a3bf1f50bb655c4, State: Initialized, Role: FOLLOWER
I20260929 06:37:33.570227 28525 consensus_queue.cc:260] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a2e303c5a79405583f87070f3cf504b" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43783 } } peers { permanent_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 38111 } } peers { permanent_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 46041 } }
I20260929 06:37:33.570461 28525 ts_tablet_manager.cc:1428] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260929 06:37:33.570495 28376 heartbeater.cc:503] Master 127.9.61.126:38997 was elected leader, sending a full tablet report...
W20260929 06:37:33.647302 28377 tablet.cc:2369] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:37:33.751583 28246 tablet.cc:2369] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:37:33.777136 28508 tablet.cc:2369] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:37:33.790692 28528 raft_consensus.cc:482] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:37:33.790807 28528 raft_consensus.cc:504] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a2e303c5a79405583f87070f3cf504b" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43783 } } peers { permanent_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 38111 } } peers { permanent_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 46041 } }
I20260929 06:37:33.791226 28528 leader_election.cc:288] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a2e303c5a79405583f87070f3cf504b (127.9.61.65:43783), bb29bfa9f6294c6b9a3bf1f50bb655c4 (127.9.61.66:38111)
I20260929 06:37:33.795113 28520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.791482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:34619 (local address 127.9.61.66:38111)
0929 06:37:33.791527 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:33.791530 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:33.791541 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:37:33.791603 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:33.791603 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:33.791613 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:33.791695 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:33.791882 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.792666 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.794213 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.794747 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.794823 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.794832 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:33.795008 (+ 176us) server_negotiation.cc:299] Negotiation successful
0929 06:37:33.795042 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:37:33.795111 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.791490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:58783 (local address 127.9.61.65:43783)
0929 06:37:33.791548 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:33.791549 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:33.791668 (+ 119us) server_negotiation.cc:407] Connection header received
0929 06:37:33.791735 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:33.791736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:33.791747 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:33.791798 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:33.792009 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.792699 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.794212 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.794749 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.794823 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.794833 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:33.794999 (+ 166us) server_negotiation.cc:299] Negotiation successful
0929 06:37:33.795039 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:37:33.795126 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.791407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:38111 (local address 127.9.61.67:34619)
0929 06:37:33.791475 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:33.791488 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:33.791533 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:33.791713 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:33.791714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:33.791716 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:33.791808 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.791810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.792768 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.792769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.794112 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.794115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.794839 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.794840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.794916 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.794919 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:33.794977 (+ 58us) client_negotiation.cc:240] Negotiation successful
0929 06:37:33.795023 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":53}
I20260929 06:37:33.795132 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.791407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43783 (local address 127.9.61.67:58783)
0929 06:37:33.791599 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:33.791608 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:33.791655 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:33.791821 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:33.791822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:33.791824 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:33.791888 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.791889 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.792768 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.792769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.794112 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:33.794115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.794840 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.794841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:33.794920 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.794923 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:33.794977 (+ 54us) client_negotiation.cc:240] Negotiation successful
0929 06:37:33.795023 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":113,"thread_start_us":113,"threads_started":1}
I20260929 06:37:33.795527 28330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99877a7156d44fd4a241ce88dcd19350" candidate_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4" is_pre_election: true
I20260929 06:37:33.795550 28199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99877a7156d44fd4a241ce88dcd19350" candidate_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a2e303c5a79405583f87070f3cf504b" is_pre_election: true
I20260929 06:37:33.795689 28330 raft_consensus.cc:2454] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6efcc8c54e04ceaa00ca9a85c936b65 in term 0.
I20260929 06:37:33.795689 28199 raft_consensus.cc:2454] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6efcc8c54e04ceaa00ca9a85c936b65 in term 0.
I20260929 06:37:33.795934 28397 leader_election.cc:302] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a2e303c5a79405583f87070f3cf504b, b6efcc8c54e04ceaa00ca9a85c936b65; no voters:
I20260929 06:37:33.796108 28528 raft_consensus.cc:2781] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:37:33.796167 28528 raft_consensus.cc:482] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:37:33.796185 28528 raft_consensus.cc:3037] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:33.796928 28528 raft_consensus.cc:504] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a2e303c5a79405583f87070f3cf504b" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43783 } } peers { permanent_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 38111 } } peers { permanent_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 46041 } }
I20260929 06:37:33.797087 28528 leader_election.cc:288] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [CANDIDATE]: Term 1 election: Requested vote from peers 4a2e303c5a79405583f87070f3cf504b (127.9.61.65:43783), bb29bfa9f6294c6b9a3bf1f50bb655c4 (127.9.61.66:38111)
I20260929 06:37:33.797230 28199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99877a7156d44fd4a241ce88dcd19350" candidate_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a2e303c5a79405583f87070f3cf504b"
I20260929 06:37:33.797304 28199 raft_consensus.cc:3037] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:33.798009 28199 raft_consensus.cc:2454] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6efcc8c54e04ceaa00ca9a85c936b65 in term 1.
I20260929 06:37:33.798144 28330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99877a7156d44fd4a241ce88dcd19350" candidate_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4"
I20260929 06:37:33.798179 28397 leader_election.cc:302] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a2e303c5a79405583f87070f3cf504b, b6efcc8c54e04ceaa00ca9a85c936b65; no voters:
I20260929 06:37:33.798229 28330 raft_consensus.cc:3037] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:33.798333 28528 raft_consensus.cc:2781] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:33.798485 28528 raft_consensus.cc:686] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 1 LEADER]: Becoming Leader. State: Replica: b6efcc8c54e04ceaa00ca9a85c936b65, State: Running, Role: LEADER
I20260929 06:37:33.798588 28528 consensus_queue.cc:237] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a2e303c5a79405583f87070f3cf504b" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43783 } } peers { permanent_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 38111 } } peers { permanent_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 46041 } }
I20260929 06:37:33.799176 28330 raft_consensus.cc:2454] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6efcc8c54e04ceaa00ca9a85c936b65 in term 1.
I20260929 06:37:33.799491 28056 catalog_manager.cc:5495] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6efcc8c54e04ceaa00ca9a85c936b65 (127.9.61.67). New cstate: current_term: 1 leader_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a2e303c5a79405583f87070f3cf504b" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 38111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6efcc8c54e04ceaa00ca9a85c936b65" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 46041 } health_report { overall_health: HEALTHY } } }
I20260929 06:37:33.846513 28519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.844139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50150 (local address 127.9.61.67:46041)
0929 06:37:33.844305 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:33.844307 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:33.844317 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:37:33.844358 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:33.844358 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:33.844377 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:33.844438 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:37:33.844595 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.845089 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.845812 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:33.845996 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:33.846048 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:33.846163 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:37:33.846246 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:37:33.846312 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:33.846418 (+ 106us) server_negotiation.cc:299] Negotiation successful
0929 06:37:33.846426 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260929 06:37:33.848322 28330 raft_consensus.cc:1261] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4 [term 1 FOLLOWER]: Refusing update from remote peer b6efcc8c54e04ceaa00ca9a85c936b65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:37:33.848322 28199 raft_consensus.cc:1261] T 99877a7156d44fd4a241ce88dcd19350 P 4a2e303c5a79405583f87070f3cf504b [term 1 FOLLOWER]: Refusing update from remote peer b6efcc8c54e04ceaa00ca9a85c936b65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:37:33.848770 28531 consensus_queue.cc:1035] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a2e303c5a79405583f87070f3cf504b" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:37:33.848914 28528 consensus_queue.cc:1035] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb29bfa9f6294c6b9a3bf1f50bb655c4" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 38111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:37:33.850929 28534 mvcc.cc:205] Tried to move back new op lower bound from 7334559145359925248 to 7334559145159720960. Current Snapshot: MvccSnapshot[applied={T|T < 7334559145359925248}]
I20260929 06:37:33.851452 28535 mvcc.cc:205] Tried to move back new op lower bound from 7334559145359925248 to 7334559145159720960. Current Snapshot: MvccSnapshot[applied={T|T < 7334559145359925248}]
I20260929 06:37:33.854116 28057 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:37:33.854206 28057 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:37:33.854949 28057 catalog_manager.cc:5782] T 00000000000000000000000000000000 P afc7ed78492542b498c7783366bf577c: Sending DeleteTablet for 3 replicas of tablet 99877a7156d44fd4a241ce88dcd19350
I20260929 06:37:33.855263 28179 tablet_service.cc:1514] Processing DeleteTablet for tablet 99877a7156d44fd4a241ce88dcd19350 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:33 UTC) from {username='slave'} at 127.0.0.1:42822
I20260929 06:37:33.855350 28310 tablet_service.cc:1514] Processing DeleteTablet for tablet 99877a7156d44fd4a241ce88dcd19350 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:33 UTC) from {username='slave'} at 127.0.0.1:54934
I20260929 06:37:33.855527 28441 tablet_service.cc:1514] Processing DeleteTablet for tablet 99877a7156d44fd4a241ce88dcd19350 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:33 UTC) from {username='slave'} at 127.0.0.1:50148
I20260929 06:37:33.855715 28546 tablet_replica.cc:330] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65: stopping tablet replica
I20260929 06:37:33.855715 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 28117
I20260929 06:37:33.855809 28546 raft_consensus.cc:2229] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 1 LEADER]: Raft consensus shutting down.
I20260929 06:37:33.855927 28546 raft_consensus.cc:2258] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:33.856462 28546 ts_tablet_manager.cc:1905] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:37:33.858490 28546 ts_tablet_manager.cc:1918] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:37:33.858567 28546 log.cc:1196] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/99877a7156d44fd4a241ce88dcd19350
I20260929 06:37:33.858827 28546 ts_tablet_manager.cc:1939] T 99877a7156d44fd4a241ce88dcd19350 P b6efcc8c54e04ceaa00ca9a85c936b65: Deleting consensus metadata
I20260929 06:37:33.859028 28545 tablet_replica.cc:330] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4: stopping tablet replica
I20260929 06:37:33.859144 28545 raft_consensus.cc:2229] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:37:33.859253 28545 raft_consensus.cc:2258] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:33.859629 28042 catalog_manager.cc:4841] TS b6efcc8c54e04ceaa00ca9a85c936b65 (127.9.61.67:46041): tablet 99877a7156d44fd4a241ce88dcd19350 (table test-table [id=b1dcb666783d46a6b37fac804fd4d400]) successfully deleted
I20260929 06:37:33.860149 28545 ts_tablet_manager.cc:1905] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:37:33.861603 28545 ts_tablet_manager.cc:1918] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:37:33.861692 28545 log.cc:1196] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/99877a7156d44fd4a241ce88dcd19350
I20260929 06:37:33.861915 28545 ts_tablet_manager.cc:1939] T 99877a7156d44fd4a241ce88dcd19350 P bb29bfa9f6294c6b9a3bf1f50bb655c4: Deleting consensus metadata
I20260929 06:37:33.862308 28041 catalog_manager.cc:4841] TS bb29bfa9f6294c6b9a3bf1f50bb655c4 (127.9.61.66:38111): tablet 99877a7156d44fd4a241ce88dcd19350 (table test-table [id=b1dcb666783d46a6b37fac804fd4d400]) successfully deleted
W20260929 06:37:33.864355 28044 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:43783 (error 108)
I20260929 06:37:33.864593 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 28248
I20260929 06:37:33.865311 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:33.864748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:43783 (local address 127.0.0.1:42826)
0929 06:37:33.865224 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:33.865271 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:43783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453}
W20260929 06:37:33.865444 28044 catalog_manager.cc:4584] TS 4a2e303c5a79405583f87070f3cf504b (127.9.61.65:43783): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 99877a7156d44fd4a241ce88dcd19350: Network error: Client connection negotiation failed: client connection to 127.9.61.65:43783: connect: Connection refused (error 111)
I20260929 06:37:33.869988 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 28379
I20260929 06:37:33.874797 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 28026
2026-09-29T06:37:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (946 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:33 dist-test-slave-601b krb5kdc[28550](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:33 dist-test-slave-601b krb5kdc[28550](info): set up 2 sockets
Sep 29 06:37:33 dist-test-slave-601b krb5kdc[28550](info): commencing operation
krb5kdc: starting...
W20260929 06:37:34.903843 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.010s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:34 dist-test-slave-601b krb5kdc[28550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:37:35.020478 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:38243
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:44183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:38243
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:35.099195 28563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:35.099429 28563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:35.099464 28563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:35.100605 28563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:35.100674 28563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:35.100699 28563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:35.100725 28563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:35.100757 28563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:35.102221 28563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:44183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:38243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:38243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:35.102492 28563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:35.102728 28563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:35.107347 28569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:35.107343 28571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:35.107465 28563 server_base.cc:1034] running on GCE node
W20260929 06:37:35.107457 28568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:35.107848 28563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:35.108146 28563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:35.109288 28563 hybrid_clock.cc:648] HybridClock initialized: now 1790663855109257 us; error 48 us; skew 500 ppm
Sep 29 06:37:35 dist-test-slave-601b krb5kdc[28550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663855, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:35.111745 28563 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:37:35.112190 28563 webserver.cc:460] Webserver started at http://127.9.61.126:42723/ using document root <none> and password file <none>
I20260929 06:37:35.112366 28563 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:35.112406 28563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:35.112488 28563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:35.113461 28563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "8337e259be23401289e80303eb042cf9"
format_stamp: "Formatted at 2026-09-29 06:37:35 on dist-test-slave-601b"
server_key: "062d98ec11079e478ea739c283b39d05"
server_key_iv: "0c863ae855788b6aa72bc44f9dc4e315"
server_key_version: "encryptionkey@0"
I20260929 06:37:35.113756 28563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "8337e259be23401289e80303eb042cf9"
format_stamp: "Formatted at 2026-09-29 06:37:35 on dist-test-slave-601b"
server_key: "062d98ec11079e478ea739c283b39d05"
server_key_iv: "0c863ae855788b6aa72bc44f9dc4e315"
server_key_version: "encryptionkey@0"
I20260929 06:37:35.115005 28563 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:37:35.115674 28578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:35.115846 28563 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:37:35.115927 28563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "8337e259be23401289e80303eb042cf9"
format_stamp: "Formatted at 2026-09-29 06:37:35 on dist-test-slave-601b"
server_key: "062d98ec11079e478ea739c283b39d05"
server_key_iv: "0c863ae855788b6aa72bc44f9dc4e315"
server_key_version: "encryptionkey@0"
I20260929 06:37:35.116072 28563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:35.125968 28563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:35.128196 28563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:35.128304 28563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:35.132385 28563 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:38243
I20260929 06:37:35.132411 28630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:38243 every 8 connection(s)
I20260929 06:37:35.132830 28563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:35.133657 28631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:35.134788 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 28563
I20260929 06:37:35.134907 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:35.135114 9461 external_mini_cluster.cc:1428] Setting key 2c07b2c63b2db46da48d13e8a999b72f
I20260929 06:37:35.136440 28631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9: Bootstrap starting.
I20260929 06:37:35.137001 28631 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:35.137291 28631 log.cc:824] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:35.137953 28631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9: No bootstrap required, opened a new log
I20260929 06:37:35.140151 28631 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8337e259be23401289e80303eb042cf9" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38243 } }
I20260929 06:37:35.140328 28631 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:35.140372 28631 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8337e259be23401289e80303eb042cf9, State: Initialized, Role: FOLLOWER
I20260929 06:37:35.140530 28631 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8337e259be23401289e80303eb042cf9" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38243 } }
I20260929 06:37:35.140614 28631 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:35.140657 28631 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:35.140705 28631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:35.141471 28631 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8337e259be23401289e80303eb042cf9" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38243 } }
I20260929 06:37:35.141588 28631 leader_election.cc:302] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8337e259be23401289e80303eb042cf9; no voters:
I20260929 06:37:35.141738 28631 leader_election.cc:288] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:35.141906 28637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:35.142011 28631 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:35.142158 28637 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [term 1 LEADER]: Becoming Leader. State: Replica: 8337e259be23401289e80303eb042cf9, State: Running, Role: LEADER
I20260929 06:37:35.142288 28637 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8337e259be23401289e80303eb042cf9" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38243 } }
Sep 29 06:37:35 dist-test-slave-601b krb5kdc[28550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:35.142693 28636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8337e259be23401289e80303eb042cf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8337e259be23401289e80303eb042cf9" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38243 } } }
I20260929 06:37:35.142796 28636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:35.143018 28636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8337e259be23401289e80303eb042cf9. Latest consensus state: current_term: 1 leader_uuid: "8337e259be23401289e80303eb042cf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8337e259be23401289e80303eb042cf9" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38243 } } }
I20260929 06:37:35.143129 28636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:35.143044 28645 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:35.146622 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.135642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39244 (local address 127.9.61.126:38243)
0929 06:37:35.135823 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:35.135832 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:35.135870 (+ 38us) server_negotiation.cc:407] Connection header received
0929 06:37:35.136384 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:35.136392 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:35.136456 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:35.136625 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:35.137459 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.138490 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.139559 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.140057 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.140144 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.143136 (+ 2992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:35.143140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:35.143141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:35.143155 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:35.145127 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:35.145506 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:35.145509 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:35.145509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:35.145614 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:35.145832 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:35.145832 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:35.145833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:35.146060 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:35.146216 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:35.146313 (+ 97us) server_negotiation.cc:299] Negotiation successful
0929 06:37:35.146447 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":87,"threads_started":1}
I20260929 06:37:35.146811 28645 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:35.148666 28645 catalog_manager.cc:1347] Generated new cluster ID: 487698962ae4466ba408a727155fb682
I20260929 06:37:35.148718 28645 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:35.161284 28645 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:35.161793 28645 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:35.174440 28645 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9: Generated new TSK 0
I20260929 06:37:35.174643 28645 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.61.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
Entry for principal kudu/127.9.61.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab.
I20260929 06:37:35.202490 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38243
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:44183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:35.298785 28657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:35.298998 28657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:35.299022 28657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:35.300269 28657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:35.300310 28657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:35.300338 28657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:37:35.301798 28657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:44183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.65.keytab
--principal=kudu/127.9.61.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:35.301990 28657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:35.302165 28657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:35.307078 28665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:35.307129 28663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:35.307135 28662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:35.307171 28657 server_base.cc:1034] running on GCE node
I20260929 06:37:35.307521 28657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:35.307726 28657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:35.308864 28657 hybrid_clock.cc:648] HybridClock initialized: now 1790663855308830 us; error 47 us; skew 500 ppm
Sep 29 06:37:35 dist-test-slave-601b krb5kdc[28550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663855, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:35.311380 28657 init.cc:377] Logged in from keytab as kudu/127.9.61.65@KRBTEST.COM (short username kudu)
I20260929 06:37:35.311861 28657 webserver.cc:460] Webserver started at http://127.9.61.65:43535/ using document root <none> and password file <none>
I20260929 06:37:35.312130 28657 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:35.312201 28657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:35.312347 28657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:35.313376 28657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "a35112cf5c314f94a47f46f608d91b0a"
format_stamp: "Formatted at 2026-09-29 06:37:35 on dist-test-slave-601b"
server_key: "0705896cd68cbd88178cefe38bf872aa"
server_key_iv: "ca4de267334606fedda299b15d8c3a30"
server_key_version: "encryptionkey@0"
I20260929 06:37:35.313741 28657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "a35112cf5c314f94a47f46f608d91b0a"
format_stamp: "Formatted at 2026-09-29 06:37:35 on dist-test-slave-601b"
server_key: "0705896cd68cbd88178cefe38bf872aa"
server_key_iv: "ca4de267334606fedda299b15d8c3a30"
server_key_version: "encryptionkey@0"
I20260929 06:37:35.315133 28657 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:37:35.315868 28672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:35.316107 28657 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:35.316205 28657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "a35112cf5c314f94a47f46f608d91b0a"
format_stamp: "Formatted at 2026-09-29 06:37:35 on dist-test-slave-601b"
server_key: "0705896cd68cbd88178cefe38bf872aa"
server_key_iv: "ca4de267334606fedda299b15d8c3a30"
server_key_version: "encryptionkey@0"
I20260929 06:37:35.316288 28657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:35.330744 28657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:35.333081 28657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:35.333244 28657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:35.333487 28657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:35.333806 28657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:35.333863 28657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:35.333899 28657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:35.333925 28657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:35.339768 28657 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:35559
I20260929 06:37:35.339821 28785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:35559 every 8 connection(s)
I20260929 06:37:35.340137 28657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
Sep 29 06:37:35 dist-test-slave-601b krb5kdc[28550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663855, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.65@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:35.347921 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 28657
I20260929 06:37:35.348099 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:37:35.348330 9461 external_mini_cluster.cc:1428] Setting key 2d2fa346fca697a23da6c5c9a1d25880
I20260929 06:37:35.349913 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.340833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:59611 (local address 127.9.61.126:38243)
0929 06:37:35.340913 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:35.340915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:35.341123 (+ 208us) server_negotiation.cc:407] Connection header received
0929 06:37:35.341596 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:35.341597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:35.341607 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:35.341661 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:35.342638 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.343288 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.344291 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.344489 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.344544 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.346588 (+ 2044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:35.346590 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:35.346590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:35.346596 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:35.348252 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:35.348871 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:35.348872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:35.348872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:35.348953 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:35.349279 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:35.349280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:35.349280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:35.349387 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:35.349445 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:35.349778 (+ 333us) server_negotiation.cc:299] Negotiation successful
0929 06:37:35.349850 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:37:35.350221 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.340795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38243 (local address 127.9.61.65:59611)
0929 06:37:35.340997 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:35.341036 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:35.341511 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:35.341713 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:35.341716 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:35.342356 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:35.342556 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:35.342562 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.343384 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.343385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:35.344222 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:35.344224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.344563 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.344564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:35.344660 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.345114 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:37:35.345122 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:35.346495 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:35.348326 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:35.348332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:35.348334 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:35.348613 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:35.349052 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:35.349053 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:35.349053 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:35.349204 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:35.349457 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:35.349463 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:35.349641 (+ 178us) client_negotiation.cc:769] Sending connection context
0929 06:37:35.349758 (+ 117us) client_negotiation.cc:240] Negotiation successful
0929 06:37:35.349936 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":118,"threads_started":1}
I20260929 06:37:35.350847 28786 heartbeater.cc:347] Connected to a master server at 127.9.61.126:38243
I20260929 06:37:35.350965 28786 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:35.351145 28786 heartbeater.cc:511] Master 127.9.61.126:38243 requested a full tablet report, sending...
I20260929 06:37:35.351783 28595 ts_manager.cc:194] Registered new tserver with Master: a35112cf5c314f94a47f46f608d91b0a (127.9.61.65:35559)
I20260929 06:37:35.352767 28595 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.65@KRBTEST.COM'} at 127.9.61.65:59611
WARNING: no policy specified for kudu/127.9.61.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
Entry for principal kudu/127.9.61.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab.
I20260929 06:37:35.375298 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38243
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:44183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:35.457513 28791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:35.457798 28791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:35.457841 28791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:35.459055 28791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:35.459146 28791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:35.459187 28791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:37:35.460707 28791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:44183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.66.keytab
--principal=kudu/127.9.61.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:35.461010 28791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:35.461259 28791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:35.466477 28799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:35.466603 28791 server_base.cc:1034] running on GCE node
W20260929 06:37:35.466480 28796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:35.466478 28797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:35.466979 28791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:35.467199 28791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:35.468369 28791 hybrid_clock.cc:648] HybridClock initialized: now 1790663855468335 us; error 61 us; skew 500 ppm
Sep 29 06:37:35 dist-test-slave-601b krb5kdc[28550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663855, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:35.470980 28791 init.cc:377] Logged in from keytab as kudu/127.9.61.66@KRBTEST.COM (short username kudu)
I20260929 06:37:35.471377 28791 webserver.cc:460] Webserver started at http://127.9.61.66:34309/ using document root <none> and password file <none>
I20260929 06:37:35.471565 28791 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:35.471606 28791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:35.471699 28791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:35.472813 28791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "f1e07a5daaf04827b2de75e120d08b37"
format_stamp: "Formatted at 2026-09-29 06:37:35 on dist-test-slave-601b"
server_key: "be42fe791c28b904e3f99c9f83e23e93"
server_key_iv: "2afb07bfb7d8ac44f2d325e797047e49"
server_key_version: "encryptionkey@0"
I20260929 06:37:35.473129 28791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "f1e07a5daaf04827b2de75e120d08b37"
format_stamp: "Formatted at 2026-09-29 06:37:35 on dist-test-slave-601b"
server_key: "be42fe791c28b904e3f99c9f83e23e93"
server_key_iv: "2afb07bfb7d8ac44f2d325e797047e49"
server_key_version: "encryptionkey@0"
I20260929 06:37:35.474432 28791 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260929 06:37:35.475241 28806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:35.475404 28791 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:37:35.475497 28791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "f1e07a5daaf04827b2de75e120d08b37"
format_stamp: "Formatted at 2026-09-29 06:37:35 on dist-test-slave-601b"
server_key: "be42fe791c28b904e3f99c9f83e23e93"
server_key_iv: "2afb07bfb7d8ac44f2d325e797047e49"
server_key_version: "encryptionkey@0"
I20260929 06:37:35.475556 28791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:35.483898 28791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:35.486349 28791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:35.486466 28791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:35.486666 28791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:35.486927 28791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:35.486958 28791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:35.486981 28791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:35.486994 28791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:35.493119 28791 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:44143
I20260929 06:37:35.493180 28919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:44143 every 8 connection(s)
I20260929 06:37:35.493572 28791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
Sep 29 06:37:35 dist-test-slave-601b krb5kdc[28550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663855, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.66@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:35.500490 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 28791
I20260929 06:37:35.500633 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:37:35.500815 9461 external_mini_cluster.cc:1428] Setting key 9468d4533602932ec9d3b6b5a9c814b9
I20260929 06:37:35.503376 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.494473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:41527 (local address 127.9.61.126:38243)
0929 06:37:35.494563 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:35.494566 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:35.494677 (+ 111us) server_negotiation.cc:407] Connection header received
0929 06:37:35.495195 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:35.495196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:35.495206 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:35.495260 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:35.496237 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.496729 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.497740 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.497921 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.497973 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.500111 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:35.500112 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:35.500113 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:35.500120 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:35.501813 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:35.502249 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:35.502250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:35.502251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:35.502316 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:35.502586 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:35.502587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:35.502588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:35.502731 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:35.502805 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:35.503162 (+ 357us) server_negotiation.cc:299] Negotiation successful
0929 06:37:35.503253 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260929 06:37:35.503459 28922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.494375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38243 (local address 127.9.61.66:41527)
0929 06:37:35.494544 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:35.494584 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:35.495098 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:35.495318 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:35.495321 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:35.495916 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:35.496140 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:35.496145 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.496817 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.496818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:35.497659 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:35.497662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.497993 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.497993 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:35.498096 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.498590 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:37:35.498599 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:35.500022 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:35.501898 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:35.501905 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:35.501909 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:35.502152 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:35.502401 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:35.502402 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:35.502402 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:35.502515 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:35.502814 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:35.502822 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:35.503017 (+ 195us) client_negotiation.cc:769] Sending connection context
0929 06:37:35.503118 (+ 101us) client_negotiation.cc:240] Negotiation successful
0929 06:37:35.503254 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260929 06:37:35.504316 28920 heartbeater.cc:347] Connected to a master server at 127.9.61.126:38243
I20260929 06:37:35.504437 28920 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:35.504642 28920 heartbeater.cc:511] Master 127.9.61.126:38243 requested a full tablet report, sending...
I20260929 06:37:35.505033 28595 ts_manager.cc:194] Registered new tserver with Master: f1e07a5daaf04827b2de75e120d08b37 (127.9.61.66:44143)
I20260929 06:37:35.505429 28595 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.66@KRBTEST.COM'} at 127.9.61.66:41527
WARNING: no policy specified for kudu/127.9.61.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
Entry for principal kudu/127.9.61.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab.
I20260929 06:37:35.527127 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38243
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:44183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:35.609942 28925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:35.610177 28925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:35.610203 28925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:35.611421 28925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:35.611472 28925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:35.611500 28925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:37:35.613173 28925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:44183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.67.keytab
--principal=kudu/127.9.61.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:38243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:35.613448 28925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:35.613706 28925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:35.618989 28931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:35.619094 28933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:35.618989 28930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:35.619452 28925 server_base.cc:1034] running on GCE node
I20260929 06:37:35.619748 28925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:35.620080 28925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:35.621248 28925 hybrid_clock.cc:648] HybridClock initialized: now 1790663855621227 us; error 39 us; skew 500 ppm
Sep 29 06:37:35 dist-test-slave-601b krb5kdc[28550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663855, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:35.624214 28925 init.cc:377] Logged in from keytab as kudu/127.9.61.67@KRBTEST.COM (short username kudu)
I20260929 06:37:35.624708 28925 webserver.cc:460] Webserver started at http://127.9.61.67:33037/ using document root <none> and password file <none>
I20260929 06:37:35.624958 28925 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:35.625008 28925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:35.625172 28925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:35.626391 28925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "d3238a2c6d3f4c8f90cf0259d76f3809"
format_stamp: "Formatted at 2026-09-29 06:37:35 on dist-test-slave-601b"
server_key: "cc91e980fb142603d0b32df05ef77663"
server_key_iv: "cea2d2fd09225e841c399ebb62af532c"
server_key_version: "encryptionkey@0"
I20260929 06:37:35.626808 28925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "d3238a2c6d3f4c8f90cf0259d76f3809"
format_stamp: "Formatted at 2026-09-29 06:37:35 on dist-test-slave-601b"
server_key: "cc91e980fb142603d0b32df05ef77663"
server_key_iv: "cea2d2fd09225e841c399ebb62af532c"
server_key_version: "encryptionkey@0"
I20260929 06:37:35.628371 28925 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:37:35.629257 28940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:35.629422 28925 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:37:35.629514 28925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "d3238a2c6d3f4c8f90cf0259d76f3809"
format_stamp: "Formatted at 2026-09-29 06:37:35 on dist-test-slave-601b"
server_key: "cc91e980fb142603d0b32df05ef77663"
server_key_iv: "cea2d2fd09225e841c399ebb62af532c"
server_key_version: "encryptionkey@0"
I20260929 06:37:35.629581 28925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:35.644261 28925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:35.646270 28925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:35.646394 28925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:35.646577 28925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:35.646905 28925 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:35.646965 28925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:35.647008 28925 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:35.647037 28925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:35.652942 28925 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:41065
I20260929 06:37:35.653035 29053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:41065 every 8 connection(s)
I20260929 06:37:35.653373 28925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
Sep 29 06:37:35 dist-test-slave-601b krb5kdc[28550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663855, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.67@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:35.662128 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 28925
I20260929 06:37:35.662220 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:37:35.662415 9461 external_mini_cluster.cc:1428] Setting key e6bbc3aad13e0c29fa9907da74dd5c49
I20260929 06:37:35.663419 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.654193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:35951 (local address 127.9.61.126:38243)
0929 06:37:35.654261 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:35.654264 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:35.654503 (+ 239us) server_negotiation.cc:407] Connection header received
0929 06:37:35.655012 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:35.655014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:35.655026 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:35.655085 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:35.656229 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.656870 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.657902 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.658125 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.658194 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.660546 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:35.660547 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:35.660548 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:35.660555 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:35.661832 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:35.662290 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:35.662291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:35.662291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:35.662356 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:35.662686 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:35.662687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:35.662687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:35.662841 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:35.662931 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:35.663237 (+ 306us) server_negotiation.cc:299] Negotiation successful
0929 06:37:35.663321 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 06:37:35.663638 29056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.654183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:38243 (local address 127.9.61.67:35951)
0929 06:37:35.654373 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:35.654412 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:35.654906 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:35.655178 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:35.655182 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:35.655802 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:35.656106 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:35.656112 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.656973 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.656974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:35.657802 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:35.657805 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.658211 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.658212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:35.658313 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.658921 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:37:35.658931 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:35.660459 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:35.661910 (+ 1451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:35.661917 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:35.661919 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:35.662180 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:35.662426 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:37:35.662427 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:37:35.662427 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:37:35.662607 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:37:35.662941 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:35.662949 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:35.663099 (+ 150us) client_negotiation.cc:769] Sending connection context
0929 06:37:35.663214 (+ 115us) client_negotiation.cc:240] Negotiation successful
0929 06:37:35.663388 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":83,"threads_started":1}
I20260929 06:37:35.664186 29054 heartbeater.cc:347] Connected to a master server at 127.9.61.126:38243
I20260929 06:37:35.664305 29054 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:35.664489 29054 heartbeater.cc:511] Master 127.9.61.126:38243 requested a full tablet report, sending...
I20260929 06:37:35.664899 28595 ts_manager.cc:194] Registered new tserver with Master: d3238a2c6d3f4c8f90cf0259d76f3809 (127.9.61.67:41065)
I20260929 06:37:35.665287 28595 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.61.67@KRBTEST.COM'} at 127.9.61.67:35951
I20260929 06:37:35.674465 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:37:35.682652 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.676016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39246 (local address 127.9.61.126:38243)
0929 06:37:35.676081 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:35.676084 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:35.676152 (+ 68us) server_negotiation.cc:407] Connection header received
0929 06:37:35.676234 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:35.676235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:35.676245 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:35.676303 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:35.676865 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.677369 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.678129 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.678415 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.678493 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.679883 (+ 1390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:35.679885 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:35.679885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:35.679893 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:35.681396 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:35.681772 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:35.681774 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:35.681774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:35.681834 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:35.682051 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:35.682052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:35.682052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:35.682217 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:35.682317 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:35.682449 (+ 132us) server_negotiation.cc:299] Negotiation successful
0929 06:37:35.682532 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:37:35.684556 28595 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39246:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:37:35.686177 28595 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:37:35.692896 29068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.688527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54002 (local address 127.9.61.67:41065)
0929 06:37:35.688886 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:35.688890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:35.689134 (+ 244us) server_negotiation.cc:407] Connection header received
0929 06:37:35.689197 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:35.689201 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:35.689219 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:35.689291 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:35.689402 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.690271 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.691569 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.692234 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.692322 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.692384 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:35.692742 (+ 358us) server_negotiation.cc:299] Negotiation successful
0929 06:37:35.692801 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":173,"threads_started":1}
I20260929 06:37:35.692893 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.688456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:41065 (local address 127.0.0.1:54002)
0929 06:37:35.689066 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:35.689075 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:35.689123 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:35.689301 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:35.689301 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:35.689303 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:35.689341 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:35.689343 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.690373 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.690374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:35.691498 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:35.691501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.692321 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.692322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:35.692401 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.692415 (+ 14us) client_negotiation.cc:769] Sending connection context
0929 06:37:35.692706 (+ 291us) client_negotiation.cc:240] Negotiation successful
0929 06:37:35.692798 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":79,"threads_started":1}
I20260929 06:37:35.693172 29069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.688673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:35559 (local address 127.0.0.1:55372)
0929 06:37:35.689191 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:35.689199 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:35.689487 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:35.689666 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:35.689667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:35.689669 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:35.689712 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:35.689713 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.690623 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.690624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:35.691828 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:35.691831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.692907 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.692908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:35.692972 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.692977 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:37:35.693027 (+ 50us) client_negotiation.cc:240] Negotiation successful
0929 06:37:35.693074 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":66,"threads_started":1}
I20260929 06:37:35.693432 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.688870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55372 (local address 127.9.61.65:35559)
0929 06:37:35.689031 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:35.689035 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:35.689458 (+ 423us) server_negotiation.cc:407] Connection header received
0929 06:37:35.689570 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:35.689573 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:35.689586 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:35.689647 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:35.689776 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.690512 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.691920 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.692750 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.692814 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.692871 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:35.693311 (+ 440us) server_negotiation.cc:299] Negotiation successful
0929 06:37:35.693357 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260929 06:37:35.693843 28988 tablet_service.cc:1467] Processing CreateTablet for tablet b86c604f64214683b11eb169b9048837 (DEFAULT_TABLE table=test-table [id=fe64c0cb327848aca00b56d66ff62bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:35.693994 29065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.688448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:44143 (local address 127.0.0.1:46722)
0929 06:37:35.688765 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:35.688809 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:35.688893 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:35.689255 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:35.689260 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:35.689263 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:35.689341 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:35.689343 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.691519 (+ 2176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.691520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:35.692497 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:35.692500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.693722 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.693724 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:35.693798 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.693803 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:37:35.693862 (+ 59us) client_negotiation.cc:240] Negotiation successful
0929 06:37:35.693921 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":65,"threads_started":1}
I20260929 06:37:35.694250 28988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b86c604f64214683b11eb169b9048837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:35.694298 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:35.688579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46722 (local address 127.9.61.66:44143)
0929 06:37:35.688797 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:35.688803 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:35.688880 (+ 77us) server_negotiation.cc:407] Connection header received
0929 06:37:35.689054 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:35.689056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:35.689073 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:35.689178 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:35.690376 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.691409 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.692698 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:35.693533 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:35.693619 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:35.693686 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:35.694152 (+ 466us) server_negotiation.cc:299] Negotiation successful
0929 06:37:35.694204 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":89,"threads_started":1}
I20260929 06:37:35.694262 28720 tablet_service.cc:1467] Processing CreateTablet for tablet b86c604f64214683b11eb169b9048837 (DEFAULT_TABLE table=test-table [id=fe64c0cb327848aca00b56d66ff62bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:35.694671 28720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b86c604f64214683b11eb169b9048837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:35.694933 28854 tablet_service.cc:1467] Processing CreateTablet for tablet b86c604f64214683b11eb169b9048837 (DEFAULT_TABLE table=test-table [id=fe64c0cb327848aca00b56d66ff62bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:35.695225 28854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b86c604f64214683b11eb169b9048837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:35.697424 29071 tablet_bootstrap.cc:492] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a: Bootstrap starting.
I20260929 06:37:35.697952 29072 tablet_bootstrap.cc:492] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809: Bootstrap starting.
I20260929 06:37:35.698186 29071 tablet_bootstrap.cc:654] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:35.698503 29073 tablet_bootstrap.cc:492] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37: Bootstrap starting.
I20260929 06:37:35.698770 29072 tablet_bootstrap.cc:654] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:35.699136 29073 tablet_bootstrap.cc:654] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:35.699162 29071 log.cc:824] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:35.699440 29072 log.cc:824] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:35.699736 29073 log.cc:824] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:35.700150 29071 tablet_bootstrap.cc:492] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a: No bootstrap required, opened a new log
I20260929 06:37:35.700217 29071 ts_tablet_manager.cc:1397] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:37:35.700356 29072 tablet_bootstrap.cc:492] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809: No bootstrap required, opened a new log
I20260929 06:37:35.700438 29072 ts_tablet_manager.cc:1397] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:37:35.702102 29072 raft_consensus.cc:348] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41065 } } peers { permanent_uuid: "f1e07a5daaf04827b2de75e120d08b37" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44143 } } peers { permanent_uuid: "a35112cf5c314f94a47f46f608d91b0a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35559 } }
I20260929 06:37:35.702108 29071 raft_consensus.cc:348] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41065 } } peers { permanent_uuid: "f1e07a5daaf04827b2de75e120d08b37" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44143 } } peers { permanent_uuid: "a35112cf5c314f94a47f46f608d91b0a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35559 } }
I20260929 06:37:35.702277 29071 raft_consensus.cc:374] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:35.702280 29072 raft_consensus.cc:374] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:35.702332 29072 raft_consensus.cc:729] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3238a2c6d3f4c8f90cf0259d76f3809, State: Initialized, Role: FOLLOWER
I20260929 06:37:35.702327 29071 raft_consensus.cc:729] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35112cf5c314f94a47f46f608d91b0a, State: Initialized, Role: FOLLOWER
I20260929 06:37:35.702454 29072 consensus_queue.cc:260] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41065 } } peers { permanent_uuid: "f1e07a5daaf04827b2de75e120d08b37" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44143 } } peers { permanent_uuid: "a35112cf5c314f94a47f46f608d91b0a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35559 } }
I20260929 06:37:35.702466 29071 consensus_queue.cc:260] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41065 } } peers { permanent_uuid: "f1e07a5daaf04827b2de75e120d08b37" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44143 } } peers { permanent_uuid: "a35112cf5c314f94a47f46f608d91b0a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35559 } }
I20260929 06:37:35.702792 29071 ts_tablet_manager.cc:1428] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:37:35.702796 29072 ts_tablet_manager.cc:1428] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:37:35.702832 28786 heartbeater.cc:503] Master 127.9.61.126:38243 was elected leader, sending a full tablet report...
I20260929 06:37:35.702899 29054 heartbeater.cc:503] Master 127.9.61.126:38243 was elected leader, sending a full tablet report...
I20260929 06:37:35.703603 29073 tablet_bootstrap.cc:492] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37: No bootstrap required, opened a new log
I20260929 06:37:35.703689 29073 ts_tablet_manager.cc:1397] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260929 06:37:35.705611 29073 raft_consensus.cc:348] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41065 } } peers { permanent_uuid: "f1e07a5daaf04827b2de75e120d08b37" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44143 } } peers { permanent_uuid: "a35112cf5c314f94a47f46f608d91b0a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35559 } }
I20260929 06:37:35.705801 29073 raft_consensus.cc:374] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:35.705853 29073 raft_consensus.cc:729] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e07a5daaf04827b2de75e120d08b37, State: Initialized, Role: FOLLOWER
I20260929 06:37:35.706000 29073 consensus_queue.cc:260] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41065 } } peers { permanent_uuid: "f1e07a5daaf04827b2de75e120d08b37" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44143 } } peers { permanent_uuid: "a35112cf5c314f94a47f46f608d91b0a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35559 } }
I20260929 06:37:35.706326 29073 ts_tablet_manager.cc:1428] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260929 06:37:35.706363 28920 heartbeater.cc:503] Master 127.9.61.126:38243 was elected leader, sending a full tablet report...
W20260929 06:37:35.744161 28921 tablet.cc:2369] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:37:35.840914 28787 tablet.cc:2369] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:37:35.904038 29055 tablet.cc:2369] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 06:37:36.033161 29077 raft_consensus.cc:482] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:37:36.033335 29077 raft_consensus.cc:504] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41065 } } peers { permanent_uuid: "f1e07a5daaf04827b2de75e120d08b37" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44143 } } peers { permanent_uuid: "a35112cf5c314f94a47f46f608d91b0a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35559 } }
I20260929 06:37:36.033751 29077 leader_election.cc:288] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3238a2c6d3f4c8f90cf0259d76f3809 (127.9.61.67:41065), f1e07a5daaf04827b2de75e120d08b37 (127.9.61.66:44143)
I20260929 06:37:36.036720 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.033982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:45465 (local address 127.9.61.66:44143)
0929 06:37:36.034059 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.034062 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.034163 (+ 101us) server_negotiation.cc:407] Connection header received
0929 06:37:36.034275 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.034277 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.034290 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.034339 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:36.034531 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.034981 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.036016 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.036375 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.036429 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.036437 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.036606 (+ 169us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.036651 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260929 06:37:36.036747 29080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.033939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:44143 (local address 127.9.61.65:45465)
0929 06:37:36.034103 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:36.034113 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:36.034189 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:36.034350 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:36.034351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:36.034353 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:36.034434 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.034436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.035083 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.035084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.035901 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.035904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.036455 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.036456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.036526 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.036531 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:37:36.036594 (+ 63us) client_negotiation.cc:240] Negotiation successful
0929 06:37:36.036626 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":19,"thread_start_us":59,"threads_started":1}
I20260929 06:37:36.036782 29081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.033929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:41065 (local address 127.9.61.65:33267)
0929 06:37:36.034064 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:36.034087 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:36.034153 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:36.034303 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:36.034304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:36.034307 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:36.034423 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.034425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.035062 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.035063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.035913 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.035915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.036511 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.036512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.036590 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.036595 (+ 5us) client_negotiation.cc:769] Sending connection context
0929 06:37:36.036651 (+ 56us) client_negotiation.cc:240] Negotiation successful
0929 06:37:36.036690 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":80,"thread_start_us":69,"threads_started":1}
I20260929 06:37:36.036798 29068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.034001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:33267 (local address 127.9.61.67:41065)
0929 06:37:36.034060 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.034062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.034144 (+ 82us) server_negotiation.cc:407] Connection header received
0929 06:37:36.034204 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.034205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.034218 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.034275 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:36.034499 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.034973 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.036028 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.036422 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.036494 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.036503 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.036675 (+ 172us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.036724 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:37:36.037217 29008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b86c604f64214683b11eb169b9048837" candidate_uuid: "a35112cf5c314f94a47f46f608d91b0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809" is_pre_election: true
I20260929 06:37:36.037288 28874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b86c604f64214683b11eb169b9048837" candidate_uuid: "a35112cf5c314f94a47f46f608d91b0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1e07a5daaf04827b2de75e120d08b37" is_pre_election: true
I20260929 06:37:36.037369 29008 raft_consensus.cc:2454] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a35112cf5c314f94a47f46f608d91b0a in term 0.
I20260929 06:37:36.037457 28874 raft_consensus.cc:2454] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a35112cf5c314f94a47f46f608d91b0a in term 0.
I20260929 06:37:36.037593 28676 leader_election.cc:302] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a35112cf5c314f94a47f46f608d91b0a, d3238a2c6d3f4c8f90cf0259d76f3809; no voters:
I20260929 06:37:36.037771 29077 raft_consensus.cc:2781] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:37:36.037808 29077 raft_consensus.cc:482] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:37:36.037824 29077 raft_consensus.cc:3037] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:36.038479 29077 raft_consensus.cc:504] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41065 } } peers { permanent_uuid: "f1e07a5daaf04827b2de75e120d08b37" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44143 } } peers { permanent_uuid: "a35112cf5c314f94a47f46f608d91b0a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35559 } }
I20260929 06:37:36.038622 29077 leader_election.cc:288] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [CANDIDATE]: Term 1 election: Requested vote from peers d3238a2c6d3f4c8f90cf0259d76f3809 (127.9.61.67:41065), f1e07a5daaf04827b2de75e120d08b37 (127.9.61.66:44143)
I20260929 06:37:36.038766 29008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b86c604f64214683b11eb169b9048837" candidate_uuid: "a35112cf5c314f94a47f46f608d91b0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809"
I20260929 06:37:36.038791 28874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b86c604f64214683b11eb169b9048837" candidate_uuid: "a35112cf5c314f94a47f46f608d91b0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1e07a5daaf04827b2de75e120d08b37"
I20260929 06:37:36.038861 29008 raft_consensus.cc:3037] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:36.038861 28874 raft_consensus.cc:3037] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:36.039724 28874 raft_consensus.cc:2454] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35112cf5c314f94a47f46f608d91b0a in term 1.
I20260929 06:37:36.039724 29008 raft_consensus.cc:2454] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a35112cf5c314f94a47f46f608d91b0a in term 1.
I20260929 06:37:36.039906 28676 leader_election.cc:302] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a35112cf5c314f94a47f46f608d91b0a, d3238a2c6d3f4c8f90cf0259d76f3809; no voters:
I20260929 06:37:36.040012 29077 raft_consensus.cc:2781] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:36.040191 29077 raft_consensus.cc:686] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [term 1 LEADER]: Becoming Leader. State: Replica: a35112cf5c314f94a47f46f608d91b0a, State: Running, Role: LEADER
I20260929 06:37:36.040287 29077 consensus_queue.cc:237] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41065 } } peers { permanent_uuid: "f1e07a5daaf04827b2de75e120d08b37" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44143 } } peers { permanent_uuid: "a35112cf5c314f94a47f46f608d91b0a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35559 } }
I20260929 06:37:36.041152 28594 catalog_manager.cc:5495] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a reported cstate change: term changed from 0 to 1, leader changed from <none> to a35112cf5c314f94a47f46f608d91b0a (127.9.61.65). New cstate: current_term: 1 leader_uuid: "a35112cf5c314f94a47f46f608d91b0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1e07a5daaf04827b2de75e120d08b37" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35112cf5c314f94a47f46f608d91b0a" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 35559 } health_report { overall_health: HEALTHY } } }
I20260929 06:37:36.049898 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.047430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55388 (local address 127.9.61.65:35559)
0929 06:37:36.047482 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.047484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.047494 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:37:36.047572 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.047573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.047598 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.047677 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:37:36.047812 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.048335 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.049100 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.049291 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.049361 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.049559 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:37:36.049662 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:37:36.049750 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.049800 (+ 50us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.049819 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260929 06:37:36.051601 29008 raft_consensus.cc:1261] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809 [term 1 FOLLOWER]: Refusing update from remote peer a35112cf5c314f94a47f46f608d91b0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:37:36.051640 28874 raft_consensus.cc:1261] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37 [term 1 FOLLOWER]: Refusing update from remote peer a35112cf5c314f94a47f46f608d91b0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:37:36.051990 29082 consensus_queue.cc:1035] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1e07a5daaf04827b2de75e120d08b37" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 44143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:37:36.052146 29077 consensus_queue.cc:1035] T b86c604f64214683b11eb169b9048837 P a35112cf5c314f94a47f46f608d91b0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3238a2c6d3f4c8f90cf0259d76f3809" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 41065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:37:36.055022 29087 mvcc.cc:205] Tried to move back new op lower bound from 7334559154384855040 to 7334559154341654528. Current Snapshot: MvccSnapshot[applied={T|T < 7334559154384855040}]
I20260929 06:37:36.057173 28595 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39246:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:37:36.057277 28595 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39246:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:37:36.057994 28595 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8337e259be23401289e80303eb042cf9: Sending DeleteTablet for 3 replicas of tablet b86c604f64214683b11eb169b9048837
I20260929 06:37:36.058293 28988 tablet_service.cc:1514] Processing DeleteTablet for tablet b86c604f64214683b11eb169b9048837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:36 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:54002
I20260929 06:37:36.058426 28854 tablet_service.cc:1514] Processing DeleteTablet for tablet b86c604f64214683b11eb169b9048837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:36 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:46722
I20260929 06:37:36.058518 29095 tablet_replica.cc:330] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809: stopping tablet replica
I20260929 06:37:36.058621 29095 raft_consensus.cc:2229] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:37:36.058609 28720 tablet_service.cc:1514] Processing DeleteTablet for tablet b86c604f64214683b11eb169b9048837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:36 UTC) from {username='kudu', principal='kudu/127.9.61.126@KRBTEST.COM'} at 127.0.0.1:55372
I20260929 06:37:36.058715 29095 raft_consensus.cc:2258] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:36.058786 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 28657
I20260929 06:37:36.059337 29096 tablet_replica.cc:330] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37: stopping tablet replica
I20260929 06:37:36.059432 29096 raft_consensus.cc:2229] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:37:36.059538 29096 raft_consensus.cc:2258] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:36.060010 29096 ts_tablet_manager.cc:1905] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:37:36.061275 29095 ts_tablet_manager.cc:1905] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:37:36.061807 29096 ts_tablet_manager.cc:1918] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:37:36.061883 29096 log.cc:1196] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/b86c604f64214683b11eb169b9048837
I20260929 06:37:36.062134 29096 ts_tablet_manager.cc:1939] T b86c604f64214683b11eb169b9048837 P f1e07a5daaf04827b2de75e120d08b37: Deleting consensus metadata
I20260929 06:37:36.062789 28581 catalog_manager.cc:4841] TS f1e07a5daaf04827b2de75e120d08b37 (127.9.61.66:44143): tablet b86c604f64214683b11eb169b9048837 (table test-table [id=fe64c0cb327848aca00b56d66ff62bfe]) successfully deleted
I20260929 06:37:36.062821 29095 ts_tablet_manager.cc:1918] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:37:36.062886 29095 log.cc:1196] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/b86c604f64214683b11eb169b9048837
I20260929 06:37:36.063185 29095 ts_tablet_manager.cc:1939] T b86c604f64214683b11eb169b9048837 P d3238a2c6d3f4c8f90cf0259d76f3809: Deleting consensus metadata
I20260929 06:37:36.063529 28582 catalog_manager.cc:4841] TS d3238a2c6d3f4c8f90cf0259d76f3809 (127.9.61.67:41065): tablet b86c604f64214683b11eb169b9048837 (table test-table [id=fe64c0cb327848aca00b56d66ff62bfe]) successfully deleted
W20260929 06:37:36.066617 28581 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:35559 (error 108)
I20260929 06:37:36.066865 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 28791
I20260929 06:37:36.067461 29065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.066982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:35559 (local address 127.0.0.1:55402)
0929 06:37:36.067404 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:36.067436 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407}
W20260929 06:37:36.067611 28581 catalog_manager.cc:4584] TS a35112cf5c314f94a47f46f608d91b0a (127.9.61.65:35559): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b86c604f64214683b11eb169b9048837: Network error: Client connection negotiation failed: client connection to 127.9.61.65:35559: connect: Connection refused (error 111)
I20260929 06:37:36.071343 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 28925
I20260929 06:37:36.075723 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 28563
2026-09-29T06:37:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2202 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-29T06:37:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:36Z Disabled control of system clock
I20260929 06:37:36.102830 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:39347
--webserver_interface=127.9.61.126
--webserver_port=0
--builtin_ntp_servers=127.9.61.84:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:39347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:37:36.182035 29102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:36.182250 29102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:36.182271 29102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:36.183570 29102 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:36.183614 29102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:36.183629 29102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:36.183641 29102 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:36.183655 29102 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:36.185093 29102 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:39347
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:39347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:36.185338 29102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:36.185642 29102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:36.190354 29108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:36.190359 29107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:36.190402 29110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:36.190665 29102 server_base.cc:1034] running on GCE node
I20260929 06:37:36.190904 29102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:36.191155 29102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:36.192291 29102 hybrid_clock.cc:648] HybridClock initialized: now 1790663856192272 us; error 40 us; skew 500 ppm
I20260929 06:37:36.193439 29102 webserver.cc:460] Webserver started at http://127.9.61.126:37059/ using document root <none> and password file <none>
I20260929 06:37:36.193629 29102 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:36.193670 29102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:36.193758 29102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:36.194744 29102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "bc258f4cd9f54ff492b50c08d3714c81"
format_stamp: "Formatted at 2026-09-29 06:37:36 on dist-test-slave-601b"
server_key: "7bb45a1133bb721a799c4180a40003d7"
server_key_iv: "2196191716ece87d6396d4944606b637"
server_key_version: "encryptionkey@0"
I20260929 06:37:36.195154 29102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "bc258f4cd9f54ff492b50c08d3714c81"
format_stamp: "Formatted at 2026-09-29 06:37:36 on dist-test-slave-601b"
server_key: "7bb45a1133bb721a799c4180a40003d7"
server_key_iv: "2196191716ece87d6396d4944606b637"
server_key_version: "encryptionkey@0"
I20260929 06:37:36.196523 29102 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:37:36.197285 29116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:36.197499 29102 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:36.197571 29102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "bc258f4cd9f54ff492b50c08d3714c81"
format_stamp: "Formatted at 2026-09-29 06:37:36 on dist-test-slave-601b"
server_key: "7bb45a1133bb721a799c4180a40003d7"
server_key_iv: "2196191716ece87d6396d4944606b637"
server_key_version: "encryptionkey@0"
I20260929 06:37:36.197671 29102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:36.242985 29102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:36.243394 29102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:36.243569 29102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:36.247665 29102 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:39347
I20260929 06:37:36.247730 29168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:39347 every 8 connection(s)
I20260929 06:37:36.248071 29102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:36.249109 29169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:36.251327 29169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81: Bootstrap starting.
I20260929 06:37:36.252032 29169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:36.252331 29169 log.cc:824] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:36.253047 29169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81: No bootstrap required, opened a new log
I20260929 06:37:36.254626 29169 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc258f4cd9f54ff492b50c08d3714c81" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39347 } }
I20260929 06:37:36.254757 29169 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:36.254779 29169 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc258f4cd9f54ff492b50c08d3714c81, State: Initialized, Role: FOLLOWER
I20260929 06:37:36.254951 29169 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc258f4cd9f54ff492b50c08d3714c81" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39347 } }
I20260929 06:37:36.255010 29169 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:36.255031 29169 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:36.255100 29169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:36.255605 29169 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc258f4cd9f54ff492b50c08d3714c81" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39347 } }
I20260929 06:37:36.255713 29169 leader_election.cc:302] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc258f4cd9f54ff492b50c08d3714c81; no voters:
I20260929 06:37:36.255888 29169 leader_election.cc:288] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:36.255985 29172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:36.256161 29169 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:36.256176 29172 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [term 1 LEADER]: Becoming Leader. State: Replica: bc258f4cd9f54ff492b50c08d3714c81, State: Running, Role: LEADER
I20260929 06:37:36.256361 29172 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc258f4cd9f54ff492b50c08d3714c81" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39347 } }
I20260929 06:37:36.256776 29174 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc258f4cd9f54ff492b50c08d3714c81. Latest consensus state: current_term: 1 leader_uuid: "bc258f4cd9f54ff492b50c08d3714c81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc258f4cd9f54ff492b50c08d3714c81" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39347 } } }
I20260929 06:37:36.256856 29173 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc258f4cd9f54ff492b50c08d3714c81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc258f4cd9f54ff492b50c08d3714c81" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 39347 } } }
I20260929 06:37:36.256919 29173 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:36.256868 29174 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:36.257347 29181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:36.257570 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 29102
I20260929 06:37:36.257684 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:36.257901 9461 external_mini_cluster.cc:1428] Setting key 519e703b1991583053b66baa8e2a29fd
I20260929 06:37:36.258005 29181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:36.260350 29181 catalog_manager.cc:1347] Generated new cluster ID: c893fe602b1943938809ac2b2ae5cef6
I20260929 06:37:36.260403 29181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:36.264083 29191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.258363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33270 (local address 127.9.61.126:39347)
0929 06:37:36.258670 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.258679 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.258708 (+ 29us) server_negotiation.cc:407] Connection header received
0929 06:37:36.258826 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.258834 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.258901 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.259168 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:36.259274 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.260670 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.261762 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.262410 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.262535 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.263253 (+ 718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:36.263257 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:36.263257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:36.263462 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:36.263503 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:36.263517 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:36.263588 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.263661 (+ 73us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.263838 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":81,"threads_started":1}
I20260929 06:37:36.278823 29181 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:36.280133 29181 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:36.284197 29181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81: Generated new TSK 0
I20260929 06:37:36.284381 29181 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:36.291227 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.65:0
--local_ip_for_outbound_sockets=127.9.61.65
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39347
--builtin_ntp_servers=127.9.61.84:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260929 06:37:36.372684 29193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:36.372915 29193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:36.372963 29193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:36.374111 29193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:36.374176 29193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:36.374217 29193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.65
I20260929 06:37:36.375569 29193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.61.65
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.65
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:36.375841 29193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:36.376180 29193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:36.381073 29201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:36.381073 29199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:36.381091 29198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:36.381532 29193 server_base.cc:1034] running on GCE node
I20260929 06:37:36.381772 29193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:36.382046 29193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:36.383210 29193 hybrid_clock.cc:648] HybridClock initialized: now 1790663856383197 us; error 44 us; skew 500 ppm
I20260929 06:37:36.384482 29193 webserver.cc:460] Webserver started at http://127.9.61.65:45021/ using document root <none> and password file <none>
I20260929 06:37:36.384725 29193 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:36.384797 29193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:36.384963 29193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:36.386102 29193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/data/instance:
uuid: "e97884ad9cc74bc998c78e95f55082a4"
format_stamp: "Formatted at 2026-09-29 06:37:36 on dist-test-slave-601b"
server_key: "f0a497bb5f2e57e67a8d26ab94413430"
server_key_iv: "e91b6c099481780b32d94bd43da8238b"
server_key_version: "encryptionkey@0"
I20260929 06:37:36.386462 29193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance:
uuid: "e97884ad9cc74bc998c78e95f55082a4"
format_stamp: "Formatted at 2026-09-29 06:37:36 on dist-test-slave-601b"
server_key: "f0a497bb5f2e57e67a8d26ab94413430"
server_key_iv: "e91b6c099481780b32d94bd43da8238b"
server_key_version: "encryptionkey@0"
I20260929 06:37:36.387724 29193 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:37:36.388505 29207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:36.388691 29193 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:36.388790 29193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/wal
uuid: "e97884ad9cc74bc998c78e95f55082a4"
format_stamp: "Formatted at 2026-09-29 06:37:36 on dist-test-slave-601b"
server_key: "f0a497bb5f2e57e67a8d26ab94413430"
server_key_iv: "e91b6c099481780b32d94bd43da8238b"
server_key_version: "encryptionkey@0"
I20260929 06:37:36.388873 29193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:36.396248 29193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:36.396520 29193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:36.396669 29193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:36.396889 29193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:36.397209 29193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:36.397262 29193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:36.397302 29193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:36.397329 29193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:36.403275 29193 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.65:46243
I20260929 06:37:36.403326 29320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.65:46243 every 8 connection(s)
I20260929 06:37:36.403635 29193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/data/info.pb
I20260929 06:37:36.406323 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 29193
I20260929 06:37:36.406437 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-0/wal/instance
I20260929 06:37:36.406638 9461 external_mini_cluster.cc:1428] Setting key da8ebd9175047dcc50a70c81be6b1e1a
I20260929 06:37:36.407582 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.66:0
--local_ip_for_outbound_sockets=127.9.61.66
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39347
--builtin_ntp_servers=127.9.61.84:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 06:37:36.409034 29191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.404294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:42567 (local address 127.9.61.126:39347)
0929 06:37:36.404362 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.404364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.404625 (+ 261us) server_negotiation.cc:407] Connection header received
0929 06:37:36.405109 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.405110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.405121 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.405179 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:36.405819 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.406312 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.407528 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.407828 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.407915 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.408765 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:36.408767 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:36.408767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:36.408772 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:36.408786 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:36.408791 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:36.408845 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.408932 (+ 87us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.408959 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260929 06:37:36.409248 29323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.404297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:39347 (local address 127.9.61.65:42567)
0929 06:37:36.404485 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:36.404526 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:36.405025 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:36.405246 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:36.405249 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:36.405258 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:36.405740 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.405745 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.406415 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.406417 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.407446 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.407448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.407923 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.407925 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.408099 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.408629 (+ 530us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:37:36.408629 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:36.408655 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:37:36.408676 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:36.408847 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:36.408852 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:36.408855 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:36.408923 (+ 68us) client_negotiation.cc:240] Negotiation successful
0929 06:37:36.409018 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":92,"threads_started":1}
I20260929 06:37:36.409741 29321 heartbeater.cc:347] Connected to a master server at 127.9.61.126:39347
I20260929 06:37:36.409816 29321 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:36.409988 29321 heartbeater.cc:511] Master 127.9.61.126:39347 requested a full tablet report, sending...
I20260929 06:37:36.410508 29133 ts_manager.cc:194] Registered new tserver with Master: e97884ad9cc74bc998c78e95f55082a4 (127.9.61.65:46243)
I20260929 06:37:36.411149 29133 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.61.65:42567
W20260929 06:37:36.487602 29324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:36.487795 29324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:36.487815 29324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:36.489045 29324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:36.489104 29324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:36.489128 29324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.66
I20260929 06:37:36.490532 29324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.61.66
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.66
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:36.490783 29324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:36.491058 29324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:36.496032 29330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:36.496054 29332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:36.496045 29324 server_base.cc:1034] running on GCE node
W20260929 06:37:36.496042 29329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:36.496366 29324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:36.496598 29324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:36.497754 29324 hybrid_clock.cc:648] HybridClock initialized: now 1790663856497751 us; error 36 us; skew 500 ppm
I20260929 06:37:36.498984 29324 webserver.cc:460] Webserver started at http://127.9.61.66:37263/ using document root <none> and password file <none>
I20260929 06:37:36.499221 29324 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:36.499287 29324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:36.499431 29324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:36.500597 29324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/data/instance:
uuid: "d805d8e08c1a4c35b52bbeda73485240"
format_stamp: "Formatted at 2026-09-29 06:37:36 on dist-test-slave-601b"
server_key: "2542db15e5d8d7ddc94a2932918fd6e5"
server_key_iv: "c93039f6d46f6b85b97ff002291e924e"
server_key_version: "encryptionkey@0"
I20260929 06:37:36.500968 29324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance:
uuid: "d805d8e08c1a4c35b52bbeda73485240"
format_stamp: "Formatted at 2026-09-29 06:37:36 on dist-test-slave-601b"
server_key: "2542db15e5d8d7ddc94a2932918fd6e5"
server_key_iv: "c93039f6d46f6b85b97ff002291e924e"
server_key_version: "encryptionkey@0"
I20260929 06:37:36.502358 29324 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:37:36.503041 29338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:36.503212 29324 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:37:36.503322 29324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/wal
uuid: "d805d8e08c1a4c35b52bbeda73485240"
format_stamp: "Formatted at 2026-09-29 06:37:36 on dist-test-slave-601b"
server_key: "2542db15e5d8d7ddc94a2932918fd6e5"
server_key_iv: "c93039f6d46f6b85b97ff002291e924e"
server_key_version: "encryptionkey@0"
I20260929 06:37:36.503402 29324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:36.533277 29324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:36.533622 29324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:36.533782 29324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:36.534020 29324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:36.534356 29324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:36.534406 29324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:36.534447 29324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:36.534482 29324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:36.540212 29324 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.66:37971
I20260929 06:37:36.540269 29451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.66:37971 every 8 connection(s)
I20260929 06:37:36.540627 29324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/data/info.pb
I20260929 06:37:36.543210 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 29324
I20260929 06:37:36.543296 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/wal/instance
I20260929 06:37:36.543497 9461 external_mini_cluster.cc:1428] Setting key 0f68f13fcff2fdf7e3600318bba5fccf
I20260929 06:37:36.544476 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.61.67:0
--local_ip_for_outbound_sockets=127.9.61.67
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39347
--builtin_ntp_servers=127.9.61.84:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260929 06:37:36.546252 29191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.541360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.66:50611 (local address 127.9.61.126:39347)
0929 06:37:36.541431 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.541434 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.541676 (+ 242us) server_negotiation.cc:407] Connection header received
0929 06:37:36.542143 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.542144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.542154 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.542210 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:36.542846 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.543391 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.544738 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.545065 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.545137 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.545969 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:36.545970 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:36.545971 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:36.545976 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:36.545992 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:36.545996 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:36.546063 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.546145 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.546174 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:37:36.546473 29454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.541356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:39347 (local address 127.9.61.66:50611)
0929 06:37:36.541553 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:36.541589 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:36.542050 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:36.542286 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:36.542289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:36.542297 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:36.542777 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.542781 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.543492 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.543493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.544648 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.544651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.545148 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.545149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.545266 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.545828 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:37:36.545829 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:36.545855 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:37:36.545876 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:36.546063 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:36.546069 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:36.546073 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:37:36.546148 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 06:37:36.546247 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
I20260929 06:37:36.546973 29452 heartbeater.cc:347] Connected to a master server at 127.9.61.126:39347
I20260929 06:37:36.547075 29452 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:36.547242 29452 heartbeater.cc:511] Master 127.9.61.126:39347 requested a full tablet report, sending...
I20260929 06:37:36.547622 29133 ts_manager.cc:194] Registered new tserver with Master: d805d8e08c1a4c35b52bbeda73485240 (127.9.61.66:37971)
I20260929 06:37:36.548084 29133 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.61.66:50611
W20260929 06:37:36.626217 29455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:36.626415 29455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:36.626436 29455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:36.627579 29455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:36.627619 29455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:36.627643 29455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.61.67
I20260929 06:37:36.628981 29455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.61.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.61.67
--webserver_port=0
--tserver_master_addrs=127.9.61.126:39347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.61.67
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:36.629228 29455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:36.629551 29455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:36.634397 29461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:36.634382 29460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:36.634370 29463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:36.634698 29455 server_base.cc:1034] running on GCE node
I20260929 06:37:36.634933 29455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:36.635186 29455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:36.636343 29455 hybrid_clock.cc:648] HybridClock initialized: now 1790663856636328 us; error 25 us; skew 500 ppm
I20260929 06:37:36.637673 29455 webserver.cc:460] Webserver started at http://127.9.61.67:44673/ using document root <none> and password file <none>
I20260929 06:37:36.637912 29455 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:36.637980 29455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:36.638135 29455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:36.639166 29455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/data/instance:
uuid: "029cc84b98be49beb197ab8c1132eb4e"
format_stamp: "Formatted at 2026-09-29 06:37:36 on dist-test-slave-601b"
server_key: "6af0eb8313cc762066dd14a791672c67"
server_key_iv: "314927dda27f7abd7a9d63ba2bb20651"
server_key_version: "encryptionkey@0"
I20260929 06:37:36.639528 29455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance:
uuid: "029cc84b98be49beb197ab8c1132eb4e"
format_stamp: "Formatted at 2026-09-29 06:37:36 on dist-test-slave-601b"
server_key: "6af0eb8313cc762066dd14a791672c67"
server_key_iv: "314927dda27f7abd7a9d63ba2bb20651"
server_key_version: "encryptionkey@0"
I20260929 06:37:36.640882 29455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:37:36.641624 29469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:36.641789 29455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:37:36.641887 29455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/wal
uuid: "029cc84b98be49beb197ab8c1132eb4e"
format_stamp: "Formatted at 2026-09-29 06:37:36 on dist-test-slave-601b"
server_key: "6af0eb8313cc762066dd14a791672c67"
server_key_iv: "314927dda27f7abd7a9d63ba2bb20651"
server_key_version: "encryptionkey@0"
I20260929 06:37:36.641964 29455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:36.662115 29455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:36.662436 29455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:36.662595 29455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:36.662818 29455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 06:37:36.663146 29455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 06:37:36.663198 29455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:36.663239 29455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 06:37:36.663267 29455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:36.668885 29455 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.67:45437
I20260929 06:37:36.668936 29582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.67:45437 every 8 connection(s)
I20260929 06:37:36.669252 29455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/data/info.pb
I20260929 06:37:36.669818 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 29455
I20260929 06:37:36.669937 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/wal/instance
I20260929 06:37:36.670128 9461 external_mini_cluster.cc:1428] Setting key 40dac1a939e65c0a4cf73e8dbb4d064d
I20260929 06:37:36.674522 29191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.669963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.67:36333 (local address 127.9.61.126:39347)
0929 06:37:36.670012 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.670015 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.670292 (+ 277us) server_negotiation.cc:407] Connection header received
0929 06:37:36.670925 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.670925 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.670937 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.671001 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:36.671758 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.672312 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.673247 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.673425 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.673474 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.674331 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:36.674332 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:36.674332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:36.674336 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:36.674346 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:36.674350 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:36.674386 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.674445 (+ 59us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.674465 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:37:36.674731 29585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.669983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:39347 (local address 127.9.61.67:36333)
0929 06:37:36.670153 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:36.670193 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:36.670845 (+ 652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:36.671168 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:36.671173 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:36.671184 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:37:36.671685 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.671690 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.672390 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.672390 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.673176 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.673177 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.673495 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.673496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.673601 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.674211 (+ 610us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0929 06:37:36.674212 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:37:36.674240 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0929 06:37:36.674262 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:37:36.674387 (+ 125us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:37:36.674389 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:37:36.674391 (+ 2us) client_negotiation.cc:769] Sending connection context
0929 06:37:36.674438 (+ 47us) client_negotiation.cc:240] Negotiation successful
0929 06:37:36.674521 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":79,"threads_started":1}
I20260929 06:37:36.675213 29583 heartbeater.cc:347] Connected to a master server at 127.9.61.126:39347
I20260929 06:37:36.675318 29583 heartbeater.cc:464] Registering TS with master...
I20260929 06:37:36.675486 29583 heartbeater.cc:511] Master 127.9.61.126:39347 requested a full tablet report, sending...
I20260929 06:37:36.675817 29133 ts_manager.cc:194] Registered new tserver with Master: 029cc84b98be49beb197ab8c1132eb4e (127.9.61.67:45437)
I20260929 06:37:36.676222 29133 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.61.67:36333
I20260929 06:37:36.681972 9461 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260929 06:37:36.686002 29191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.683329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33286 (local address 127.9.61.126:39347)
0929 06:37:36.683380 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.683383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.683482 (+ 99us) server_negotiation.cc:407] Connection header received
0929 06:37:36.683536 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.683537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.683547 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.683587 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:36.683727 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.684251 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.684937 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.685105 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.685170 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.685849 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:36.685849 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:36.685850 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:36.685853 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:36.685862 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:36.685865 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:36.685902 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.685936 (+ 34us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.685952 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:37:36.687482 29133 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 06:37:36.689060 29133 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 06:37:36.695458 29595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.691170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:45437 (local address 127.0.0.1:43774)
0929 06:37:36.691544 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:36.691597 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:36.691671 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:36.691989 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:36.691992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:36.691995 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:36.692077 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.692079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.693393 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.693394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.694336 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.694339 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.695203 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.695204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.695257 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.695267 (+ 10us) client_negotiation.cc:769] Sending connection context
0929 06:37:36.695315 (+ 48us) client_negotiation.cc:240] Negotiation successful
0929 06:37:36.695349 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":5,"thread_start_us":70,"threads_started":1}
I20260929 06:37:36.695466 29593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.691245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43774 (local address 127.9.61.67:45437)
0929 06:37:36.691385 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.691390 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.691760 (+ 370us) server_negotiation.cc:407] Connection header received
0929 06:37:36.691804 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.691806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.691822 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.691891 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:36.692214 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.693292 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.694434 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.695106 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.695185 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.695272 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.695340 (+ 68us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.695388 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":81,"threads_started":1}
I20260929 06:37:36.695621 29592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.691177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:37971 (local address 127.0.0.1:49960)
0929 06:37:36.691553 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:36.691596 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:36.691707 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:36.692009 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:36.692009 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:36.692012 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:36.692082 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.692083 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.693377 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.693378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.694541 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.694543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.695413 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.695414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.695467 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.695471 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:37:36.695526 (+ 55us) client_negotiation.cc:240] Negotiation successful
0929 06:37:36.695561 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":46,"thread_start_us":100,"threads_started":1}
I20260929 06:37:36.695866 29594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.691297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49960 (local address 127.9.61.66:37971)
0929 06:37:36.691475 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.691479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.691681 (+ 202us) server_negotiation.cc:407] Connection header received
0929 06:37:36.691812 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.691814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.691829 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.691897 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:36.692174 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.693306 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.694638 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.695333 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.695399 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.695475 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.695735 (+ 260us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.695782 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":69,"threads_started":1}
I20260929 06:37:36.696602 29517 tablet_service.cc:1467] Processing CreateTablet for tablet 8410b14e73de46b1a7f8b03c3a6817c2 (DEFAULT_TABLE table=test-table [id=bbf3b68663814f13be0c8d0a3538bff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:36.696604 29386 tablet_service.cc:1467] Processing CreateTablet for tablet 8410b14e73de46b1a7f8b03c3a6817c2 (DEFAULT_TABLE table=test-table [id=bbf3b68663814f13be0c8d0a3538bff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:36.696897 29591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.691387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:46243 (local address 127.0.0.1:59300)
0929 06:37:36.691619 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:36.691628 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:36.691674 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:36.692161 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:36.692161 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:36.692163 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:36.692200 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.692202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.693267 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.693268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.694541 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.694543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.696664 (+ 2121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.696665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.696724 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.696728 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:37:36.696794 (+ 66us) client_negotiation.cc:240] Negotiation successful
0929 06:37:36.696831 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":7,"thread_start_us":82,"threads_started":1}
I20260929 06:37:36.696918 29596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.691632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59300 (local address 127.9.61.65:46243)
0929 06:37:36.691825 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.691829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.691838 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:37:36.691877 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.691878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.691892 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.692277 (+ 385us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:36.692335 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.693185 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.695512 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.696558 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.696660 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.696745 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.696809 (+ 64us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.696843 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":84,"threads_started":1}
I20260929 06:37:36.696969 29386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8410b14e73de46b1a7f8b03c3a6817c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:36.696964 29517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8410b14e73de46b1a7f8b03c3a6817c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:36.697515 29255 tablet_service.cc:1467] Processing CreateTablet for tablet 8410b14e73de46b1a7f8b03c3a6817c2 (DEFAULT_TABLE table=test-table [id=bbf3b68663814f13be0c8d0a3538bff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260929 06:37:36.697752 29255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8410b14e73de46b1a7f8b03c3a6817c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:36.700526 29599 tablet_bootstrap.cc:492] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4: Bootstrap starting.
I20260929 06:37:36.700544 29597 tablet_bootstrap.cc:492] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240: Bootstrap starting.
I20260929 06:37:36.701150 29599 tablet_bootstrap.cc:654] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:36.701171 29597 tablet_bootstrap.cc:654] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:36.701473 29597 log.cc:824] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:36.701507 29599 log.cc:824] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:36.701823 29598 tablet_bootstrap.cc:492] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e: Bootstrap starting.
I20260929 06:37:36.702291 29599 tablet_bootstrap.cc:492] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4: No bootstrap required, opened a new log
I20260929 06:37:36.702425 29598 tablet_bootstrap.cc:654] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:36.702389 29599 ts_tablet_manager.cc:1397] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:37:36.702747 29598 log.cc:824] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:36.703388 29598 tablet_bootstrap.cc:492] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e: No bootstrap required, opened a new log
I20260929 06:37:36.703474 29598 ts_tablet_manager.cc:1397] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260929 06:37:36.703516 29597 tablet_bootstrap.cc:492] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240: No bootstrap required, opened a new log
I20260929 06:37:36.703586 29597 ts_tablet_manager.cc:1397] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260929 06:37:36.705200 29599 raft_consensus.cc:348] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "029cc84b98be49beb197ab8c1132eb4e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45437 } } peers { permanent_uuid: "e97884ad9cc74bc998c78e95f55082a4" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 46243 } } peers { permanent_uuid: "d805d8e08c1a4c35b52bbeda73485240" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37971 } }
I20260929 06:37:36.705302 29598 raft_consensus.cc:348] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "029cc84b98be49beb197ab8c1132eb4e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45437 } } peers { permanent_uuid: "e97884ad9cc74bc998c78e95f55082a4" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 46243 } } peers { permanent_uuid: "d805d8e08c1a4c35b52bbeda73485240" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37971 } }
I20260929 06:37:36.705374 29599 raft_consensus.cc:374] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:36.705459 29599 raft_consensus.cc:729] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e97884ad9cc74bc998c78e95f55082a4, State: Initialized, Role: FOLLOWER
I20260929 06:37:36.705459 29598 raft_consensus.cc:374] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:36.705495 29598 raft_consensus.cc:729] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 029cc84b98be49beb197ab8c1132eb4e, State: Initialized, Role: FOLLOWER
I20260929 06:37:36.705590 29599 consensus_queue.cc:260] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "029cc84b98be49beb197ab8c1132eb4e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45437 } } peers { permanent_uuid: "e97884ad9cc74bc998c78e95f55082a4" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 46243 } } peers { permanent_uuid: "d805d8e08c1a4c35b52bbeda73485240" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37971 } }
I20260929 06:37:36.705600 29598 consensus_queue.cc:260] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "029cc84b98be49beb197ab8c1132eb4e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45437 } } peers { permanent_uuid: "e97884ad9cc74bc998c78e95f55082a4" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 46243 } } peers { permanent_uuid: "d805d8e08c1a4c35b52bbeda73485240" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37971 } }
I20260929 06:37:36.705845 29599 ts_tablet_manager.cc:1428] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260929 06:37:36.705847 29598 ts_tablet_manager.cc:1428] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260929 06:37:36.705864 29583 heartbeater.cc:503] Master 127.9.61.126:39347 was elected leader, sending a full tablet report...
I20260929 06:37:36.705981 29321 heartbeater.cc:503] Master 127.9.61.126:39347 was elected leader, sending a full tablet report...
I20260929 06:37:36.706111 29597 raft_consensus.cc:348] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "029cc84b98be49beb197ab8c1132eb4e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45437 } } peers { permanent_uuid: "e97884ad9cc74bc998c78e95f55082a4" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 46243 } } peers { permanent_uuid: "d805d8e08c1a4c35b52bbeda73485240" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37971 } }
I20260929 06:37:36.706270 29597 raft_consensus.cc:374] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:36.706314 29597 raft_consensus.cc:729] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d805d8e08c1a4c35b52bbeda73485240, State: Initialized, Role: FOLLOWER
I20260929 06:37:36.706497 29597 consensus_queue.cc:260] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "029cc84b98be49beb197ab8c1132eb4e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45437 } } peers { permanent_uuid: "e97884ad9cc74bc998c78e95f55082a4" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 46243 } } peers { permanent_uuid: "d805d8e08c1a4c35b52bbeda73485240" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37971 } }
I20260929 06:37:36.706768 29597 ts_tablet_manager.cc:1428] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260929 06:37:36.706883 29452 heartbeater.cc:503] Master 127.9.61.126:39347 was elected leader, sending a full tablet report...
I20260929 06:37:36.722858 29603 raft_consensus.cc:482] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 06:37:36.722957 29603 raft_consensus.cc:504] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "029cc84b98be49beb197ab8c1132eb4e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45437 } } peers { permanent_uuid: "e97884ad9cc74bc998c78e95f55082a4" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 46243 } } peers { permanent_uuid: "d805d8e08c1a4c35b52bbeda73485240" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37971 } }
I20260929 06:37:36.723266 29603 leader_election.cc:288] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 029cc84b98be49beb197ab8c1132eb4e (127.9.61.67:45437), d805d8e08c1a4c35b52bbeda73485240 (127.9.61.66:37971)
I20260929 06:37:36.727262 29593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.723529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:56989 (local address 127.9.61.67:45437)
0929 06:37:36.723593 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.723595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.723623 (+ 28us) server_negotiation.cc:407] Connection header received
0929 06:37:36.723660 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.723660 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.723669 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.723714 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:36.723914 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.724801 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.726346 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.726903 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.726984 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.726995 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.727161 (+ 166us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.727199 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260929 06:37:36.727263 29323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.723464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.67:45437 (local address 127.9.61.65:56989)
0929 06:37:36.723519 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:36.723531 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:36.723573 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:36.723745 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:36.723746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:36.723748 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:36.723815 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.723817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.724907 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.724908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.726231 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.726233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.726987 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.726988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.727067 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.727070 (+ 3us) client_negotiation.cc:769] Sending connection context
0929 06:37:36.727149 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:37:36.727192 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":49}
I20260929 06:37:36.727352 29594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.723538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.61.65:53915 (local address 127.9.61.66:37971)
0929 06:37:36.723577 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.723578 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.723762 (+ 184us) server_negotiation.cc:407] Connection header received
0929 06:37:36.723803 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.723804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.723814 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.723861 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0929 06:37:36.724072 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.724845 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.726332 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.726905 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.727041 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.727051 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.727228 (+ 177us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.727267 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:37:36.727596 29606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.723479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.66:37971 (local address 127.9.61.65:53915)
0929 06:37:36.723667 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:36.723675 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0929 06:37:36.723745 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:37:36.723881 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:37:36.723882 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:37:36.723884 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0929 06:37:36.723991 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.723993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.724920 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.724920 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.726231 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:37:36.726233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.727043 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.727045 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:37:36.727142 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.727146 (+ 4us) client_negotiation.cc:769] Sending connection context
0929 06:37:36.727221 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 06:37:36.727263 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":63,"thread_start_us":105,"threads_started":1}
I20260929 06:37:36.727573 29537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8410b14e73de46b1a7f8b03c3a6817c2" candidate_uuid: "e97884ad9cc74bc998c78e95f55082a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "029cc84b98be49beb197ab8c1132eb4e" is_pre_election: true
I20260929 06:37:36.727715 29537 raft_consensus.cc:2454] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e97884ad9cc74bc998c78e95f55082a4 in term 0.
I20260929 06:37:36.727988 29406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8410b14e73de46b1a7f8b03c3a6817c2" candidate_uuid: "e97884ad9cc74bc998c78e95f55082a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805d8e08c1a4c35b52bbeda73485240" is_pre_election: true
I20260929 06:37:36.728103 29406 raft_consensus.cc:2454] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e97884ad9cc74bc998c78e95f55082a4 in term 0.
I20260929 06:37:36.728138 29209 leader_election.cc:302] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 029cc84b98be49beb197ab8c1132eb4e, e97884ad9cc74bc998c78e95f55082a4; no voters:
I20260929 06:37:36.728251 29603 raft_consensus.cc:2781] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 06:37:36.728312 29603 raft_consensus.cc:482] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 06:37:36.728349 29603 raft_consensus.cc:3037] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:36.729027 29603 raft_consensus.cc:504] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "029cc84b98be49beb197ab8c1132eb4e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45437 } } peers { permanent_uuid: "e97884ad9cc74bc998c78e95f55082a4" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 46243 } } peers { permanent_uuid: "d805d8e08c1a4c35b52bbeda73485240" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37971 } }
I20260929 06:37:36.729156 29603 leader_election.cc:288] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [CANDIDATE]: Term 1 election: Requested vote from peers 029cc84b98be49beb197ab8c1132eb4e (127.9.61.67:45437), d805d8e08c1a4c35b52bbeda73485240 (127.9.61.66:37971)
I20260929 06:37:36.729333 29537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8410b14e73de46b1a7f8b03c3a6817c2" candidate_uuid: "e97884ad9cc74bc998c78e95f55082a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "029cc84b98be49beb197ab8c1132eb4e"
I20260929 06:37:36.729456 29406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8410b14e73de46b1a7f8b03c3a6817c2" candidate_uuid: "e97884ad9cc74bc998c78e95f55082a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d805d8e08c1a4c35b52bbeda73485240"
I20260929 06:37:36.729442 29537 raft_consensus.cc:3037] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:36.729535 29406 raft_consensus.cc:3037] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:36.730238 29406 raft_consensus.cc:2454] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e97884ad9cc74bc998c78e95f55082a4 in term 1.
I20260929 06:37:36.730305 29537 raft_consensus.cc:2454] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e97884ad9cc74bc998c78e95f55082a4 in term 1.
I20260929 06:37:36.730491 29209 leader_election.cc:302] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 029cc84b98be49beb197ab8c1132eb4e, e97884ad9cc74bc998c78e95f55082a4; no voters:
I20260929 06:37:36.730603 29603 raft_consensus.cc:2781] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:36.730779 29603 raft_consensus.cc:686] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [term 1 LEADER]: Becoming Leader. State: Replica: e97884ad9cc74bc998c78e95f55082a4, State: Running, Role: LEADER
I20260929 06:37:36.730882 29603 consensus_queue.cc:237] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "029cc84b98be49beb197ab8c1132eb4e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45437 } } peers { permanent_uuid: "e97884ad9cc74bc998c78e95f55082a4" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 46243 } } peers { permanent_uuid: "d805d8e08c1a4c35b52bbeda73485240" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37971 } }
I20260929 06:37:36.731801 29133 catalog_manager.cc:5495] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e97884ad9cc74bc998c78e95f55082a4 (127.9.61.65). New cstate: current_term: 1 leader_uuid: "e97884ad9cc74bc998c78e95f55082a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "029cc84b98be49beb197ab8c1132eb4e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e97884ad9cc74bc998c78e95f55082a4" member_type: VOTER last_known_addr { host: "127.9.61.65" port: 46243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d805d8e08c1a4c35b52bbeda73485240" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260929 06:37:36.740036 29596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.737921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59316 (local address 127.9.61.65:46243)
0929 06:37:36.737967 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:36.737968 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:36.737976 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:37:36.738038 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:36.738038 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:36.738054 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:36.738108 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:37:36.738235 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.738679 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.739364 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:36.739533 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:36.739578 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:36.739711 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:37:36.739798 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:37:36.739855 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:36.739887 (+ 32us) server_negotiation.cc:299] Negotiation successful
0929 06:37:36.739904 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260929 06:37:36.741673 29406 raft_consensus.cc:1261] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240 [term 1 FOLLOWER]: Refusing update from remote peer e97884ad9cc74bc998c78e95f55082a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:37:36.741688 29537 raft_consensus.cc:1261] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e [term 1 FOLLOWER]: Refusing update from remote peer e97884ad9cc74bc998c78e95f55082a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:37:36.742017 29603 consensus_queue.cc:1035] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "029cc84b98be49beb197ab8c1132eb4e" member_type: VOTER last_known_addr { host: "127.9.61.67" port: 45437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:37:36.742154 29607 consensus_queue.cc:1035] T 8410b14e73de46b1a7f8b03c3a6817c2 P e97884ad9cc74bc998c78e95f55082a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d805d8e08c1a4c35b52bbeda73485240" member_type: VOTER last_known_addr { host: "127.9.61.66" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:37:36.744498 29610 mvcc.cc:205] Tried to move back new op lower bound from 7334559157211373568 to 7334559157170696192. Current Snapshot: MvccSnapshot[applied={T|T < 7334559157211373568}]
I20260929 06:37:36.745591 29611 mvcc.cc:205] Tried to move back new op lower bound from 7334559157211373568 to 7334559157170696192. Current Snapshot: MvccSnapshot[applied={T|T < 7334559157211373568}]
I20260929 06:37:36.747042 29132 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:37:36.747140 29132 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260929 06:37:36.747927 29132 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bc258f4cd9f54ff492b50c08d3714c81: Sending DeleteTablet for 3 replicas of tablet 8410b14e73de46b1a7f8b03c3a6817c2
I20260929 06:37:36.748265 29386 tablet_service.cc:1514] Processing DeleteTablet for tablet 8410b14e73de46b1a7f8b03c3a6817c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:36 UTC) from {username='slave'} at 127.0.0.1:49960
I20260929 06:37:36.748272 29255 tablet_service.cc:1514] Processing DeleteTablet for tablet 8410b14e73de46b1a7f8b03c3a6817c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:36 UTC) from {username='slave'} at 127.0.0.1:59300
I20260929 06:37:36.748492 29517 tablet_service.cc:1514] Processing DeleteTablet for tablet 8410b14e73de46b1a7f8b03c3a6817c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-29 06:37:36 UTC) from {username='slave'} at 127.0.0.1:43774
I20260929 06:37:36.748808 29619 tablet_replica.cc:330] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240: stopping tablet replica
I20260929 06:37:36.748764 29621 tablet_replica.cc:330] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e: stopping tablet replica
I20260929 06:37:36.748914 29619 raft_consensus.cc:2229] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:37:36.748992 29621 raft_consensus.cc:2229] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 06:37:36.749023 29619 raft_consensus.cc:2258] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:36.749130 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 29193
I20260929 06:37:36.749850 29621 raft_consensus.cc:2258] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 06:37:36.750259 29621 ts_tablet_manager.cc:1905] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:37:36.751605 29621 ts_tablet_manager.cc:1918] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:37:36.751698 29621 log.cc:1196] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-2/wal/wals/8410b14e73de46b1a7f8b03c3a6817c2
I20260929 06:37:36.751924 29621 ts_tablet_manager.cc:1939] T 8410b14e73de46b1a7f8b03c3a6817c2 P 029cc84b98be49beb197ab8c1132eb4e: Deleting consensus metadata
I20260929 06:37:36.752341 29118 catalog_manager.cc:4841] TS 029cc84b98be49beb197ab8c1132eb4e (127.9.61.67:45437): tablet 8410b14e73de46b1a7f8b03c3a6817c2 (table test-table [id=bbf3b68663814f13be0c8d0a3538bff7]) successfully deleted
I20260929 06:37:36.752643 29619 ts_tablet_manager.cc:1905] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260929 06:37:36.753947 29619 ts_tablet_manager.cc:1918] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260929 06:37:36.754040 29619 log.cc:1196] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240: Deleting WAL directory at /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790663621200347-9461-0/minicluster-data/ts-1/wal/wals/8410b14e73de46b1a7f8b03c3a6817c2
I20260929 06:37:36.754269 29619 ts_tablet_manager.cc:1939] T 8410b14e73de46b1a7f8b03c3a6817c2 P d805d8e08c1a4c35b52bbeda73485240: Deleting consensus metadata
W20260929 06:37:36.754644 29118 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.61.65:46243 (error 108)
I20260929 06:37:36.754805 29120 catalog_manager.cc:4841] TS d805d8e08c1a4c35b52bbeda73485240 (127.9.61.66:37971): tablet 8410b14e73de46b1a7f8b03c3a6817c2 (table test-table [id=bbf3b68663814f13be0c8d0a3538bff7]) successfully deleted
I20260929 06:37:36.755134 29591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:36.754997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.65:46243 (local address 127.0.0.1:59330)
0929 06:37:36.755050 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 06:37:36.755090 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.65:46243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260929 06:37:36.755195 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 29324
W20260929 06:37:36.756119 29118 catalog_manager.cc:4584] TS e97884ad9cc74bc998c78e95f55082a4 (127.9.61.65:46243): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8410b14e73de46b1a7f8b03c3a6817c2: Network error: Client connection negotiation failed: client connection to 127.9.61.65:46243: connect: Connection refused (error 111)
I20260929 06:37:36.760941 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 29455
I20260929 06:37:36.765475 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 29102
2026-09-29T06:37:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (688 ms)
[----------] 6 tests from EncryptionPolicyTest (8462 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:36 dist-test-slave-601b krb5kdc[29625](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:36 dist-test-slave-601b krb5kdc[29625](info): set up 2 sockets
Sep 29 06:37:36 dist-test-slave-601b krb5kdc[29625](info): commencing operation
krb5kdc: starting...
W20260929 06:37:37.808137 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:37 dist-test-slave-601b krb5kdc[29625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:37:37.926733 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45439
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:38.010805 29638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:38.011035 29638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:38.011060 29638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:38.012337 29638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:38.012382 29638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:38.012396 29638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:38.012440 29638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:38.012466 29638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:38.013968 29638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45439
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:38.014225 29638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:38.014463 29638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:38.019239 29646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:38.019289 29644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:38.019258 29643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:38.019418 29638 server_base.cc:1034] running on GCE node
I20260929 06:37:38.019796 29638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:38.020128 29638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:38.021272 29638 hybrid_clock.cc:648] HybridClock initialized: now 1790663858021261 us; error 31 us; skew 500 ppm
Sep 29 06:37:38 dist-test-slave-601b krb5kdc[29625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663858, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:38.023835 29638 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:37:38.024439 29638 webserver.cc:460] Webserver started at http://127.0.0.1:45525/ using document root <none> and password file <none>
I20260929 06:37:38.024631 29638 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:38.024673 29638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:38.024761 29638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:38.025761 29638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "e2f15c9a58134e87b2d405e7e25ddc49"
format_stamp: "Formatted at 2026-09-29 06:37:38 on dist-test-slave-601b"
server_key: "39103f0650a1ac195449e51682f3355c"
server_key_iv: "b7699a0a449c25962b3a57b1f76d1b50"
server_key_version: "encryptionkey@0"
I20260929 06:37:38.026100 29638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "e2f15c9a58134e87b2d405e7e25ddc49"
format_stamp: "Formatted at 2026-09-29 06:37:38 on dist-test-slave-601b"
server_key: "39103f0650a1ac195449e51682f3355c"
server_key_iv: "b7699a0a449c25962b3a57b1f76d1b50"
server_key_version: "encryptionkey@0"
I20260929 06:37:38.027683 29638 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:37:38.028635 29653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:38.028841 29638 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:38.028913 29638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "e2f15c9a58134e87b2d405e7e25ddc49"
format_stamp: "Formatted at 2026-09-29 06:37:38 on dist-test-slave-601b"
server_key: "39103f0650a1ac195449e51682f3355c"
server_key_iv: "b7699a0a449c25962b3a57b1f76d1b50"
server_key_version: "encryptionkey@0"
I20260929 06:37:38.028965 29638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:38.046535 29638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:38.048491 29638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:38.048599 29638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:38.052423 29638 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45439
I20260929 06:37:38.052495 29705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45439 every 8 connection(s)
I20260929 06:37:38.052835 29638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:38.053813 29706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:38.056033 29706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49: Bootstrap starting.
I20260929 06:37:38.056620 29706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:38.056901 29706 log.cc:824] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:38.057582 29706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49: No bootstrap required, opened a new log
I20260929 06:37:38.059110 29706 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2f15c9a58134e87b2d405e7e25ddc49" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45439 } }
I20260929 06:37:38.059243 29706 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:38.059265 29706 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2f15c9a58134e87b2d405e7e25ddc49, State: Initialized, Role: FOLLOWER
I20260929 06:37:38.059429 29706 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2f15c9a58134e87b2d405e7e25ddc49" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45439 } }
I20260929 06:37:38.059510 29706 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:38.059553 29706 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:38.059608 29706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:38.060151 29706 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2f15c9a58134e87b2d405e7e25ddc49" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45439 } }
I20260929 06:37:38.060259 29706 leader_election.cc:302] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2f15c9a58134e87b2d405e7e25ddc49; no voters:
I20260929 06:37:38.060436 29706 leader_election.cc:288] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:38.060465 29709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:38.060639 29709 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [term 1 LEADER]: Becoming Leader. State: Replica: e2f15c9a58134e87b2d405e7e25ddc49, State: Running, Role: LEADER
I20260929 06:37:38.060694 29706 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:38.060758 29709 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2f15c9a58134e87b2d405e7e25ddc49" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45439 } }
I20260929 06:37:38.061189 29711 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2f15c9a58134e87b2d405e7e25ddc49. Latest consensus state: current_term: 1 leader_uuid: "e2f15c9a58134e87b2d405e7e25ddc49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2f15c9a58134e87b2d405e7e25ddc49" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45439 } } }
I20260929 06:37:38.061307 29710 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2f15c9a58134e87b2d405e7e25ddc49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2f15c9a58134e87b2d405e7e25ddc49" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45439 } } }
I20260929 06:37:38.061383 29711 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:38.061678 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 29638
I20260929 06:37:38.061800 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:38.062021 9461 external_mini_cluster.cc:1428] Setting key 133a152c7a8b86337e63cf3ca8d91f76
I20260929 06:37:38.061455 29710 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49 [sys.catalog]: This master's current role is: LEADER
W20260929 06:37:38.062659 29724 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:37:38.062724 29724 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:37:38.062798 29725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:38.062969 29725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:38.064385 29725 catalog_manager.cc:1347] Generated new cluster ID: 6635d5e0eb9b4a1aa1f6c8ddf7711346
I20260929 06:37:38.064435 29725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:37:38 dist-test-slave-601b krb5kdc[29625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 06:37:38.073731 29728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:38.062539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55855 (local address 127.0.0.1:45439)
0929 06:37:38.063069 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:38.063079 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:38.063110 (+ 31us) server_negotiation.cc:407] Connection header received
0929 06:37:38.063209 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:38.063215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:38.063255 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:38.063388 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:38.064121 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:38.065471 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:38.066505 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:38.067111 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:38.067194 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:38.069947 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:38.069951 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:38.069952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:38.069963 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:38.071856 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:38.072287 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:38.072290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:38.072290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:38.072384 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:38.072574 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:38.072575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:38.072575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:38.072860 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:38.072981 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:38.073417 (+ 436us) server_negotiation.cc:299] Negotiation successful
0929 06:37:38.073512 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":77,"threads_started":1}
I20260929 06:37:38.074620 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:38.083446 29728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:38.076174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36589 (local address 127.0.0.1:45439)
0929 06:37:38.076205 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:38.076206 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:38.076337 (+ 131us) server_negotiation.cc:407] Connection header received
0929 06:37:38.076385 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:38.076386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:38.076395 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:38.076449 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:38.077105 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:38.077844 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:38.078877 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:38.079182 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:38.079244 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:38.080699 (+ 1455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:38.080701 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:38.080701 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:38.080707 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:38.082211 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:38.082652 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:38.082653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:38.082653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:38.082706 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:38.082941 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:38.082942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:38.082942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:38.083063 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:38.083157 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:38.083305 (+ 148us) server_negotiation.cc:299] Negotiation successful
0929 06:37:38.083363 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260929 06:37:38.088831 29725 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:38.089322 29725 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:38.092192 29725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2f15c9a58134e87b2d405e7e25ddc49: Generated new TSK 0
I20260929 06:37:38.092396 29725 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:38.097337 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 29638
W20260929 06:37:38.101720 29623 connection.cc:535] client connection to 127.0.0.1:45439 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45439): Connection reset by peer (error 104)
2026-09-29T06:37:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1330 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:38 dist-test-slave-601b krb5kdc[29737](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:38 dist-test-slave-601b krb5kdc[29737](info): set up 2 sockets
Sep 29 06:37:38 dist-test-slave-601b krb5kdc[29737](info): commencing operation
krb5kdc: starting...
W20260929 06:37:39.136571 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:39 dist-test-slave-601b krb5kdc[29737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:37:39.258899 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42299
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42299
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:39.342211 29750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:39.342496 29750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:39.342541 29750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:39.343707 29750 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:39.343792 29750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:39.343817 29750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:39.343839 29750 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:39.343868 29750 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:39.345371 29750 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42299
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:39.345674 29750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:39.345911 29750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:39.350863 29756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:39.350883 29755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:39.350883 29750 server_base.cc:1034] running on GCE node
W20260929 06:37:39.350864 29758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:39.351305 29750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:39.351559 29750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:39.352727 29750 hybrid_clock.cc:648] HybridClock initialized: now 1790663859352714 us; error 48 us; skew 500 ppm
Sep 29 06:37:39 dist-test-slave-601b krb5kdc[29737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663859, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:39.358620 29750 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:37:39.359150 29750 webserver.cc:460] Webserver started at http://127.0.0.1:33969/ using document root <none> and password file <none>
I20260929 06:37:39.359404 29750 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:39.359476 29750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:39.359630 29750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:39.360785 29750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "db83ba88f9d04b36bad01c245ba367f6"
format_stamp: "Formatted at 2026-09-29 06:37:39 on dist-test-slave-601b"
server_key: "329face80b819e7cc64da2bd45fe1f69"
server_key_iv: "0da69b0c78812763624a8a6a0d0738be"
server_key_version: "encryptionkey@0"
I20260929 06:37:39.361181 29750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "db83ba88f9d04b36bad01c245ba367f6"
format_stamp: "Formatted at 2026-09-29 06:37:39 on dist-test-slave-601b"
server_key: "329face80b819e7cc64da2bd45fe1f69"
server_key_iv: "0da69b0c78812763624a8a6a0d0738be"
server_key_version: "encryptionkey@0"
I20260929 06:37:39.362494 29750 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:37:39.363215 29765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:39.363420 29750 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:37:39.363515 29750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "db83ba88f9d04b36bad01c245ba367f6"
format_stamp: "Formatted at 2026-09-29 06:37:39 on dist-test-slave-601b"
server_key: "329face80b819e7cc64da2bd45fe1f69"
server_key_iv: "0da69b0c78812763624a8a6a0d0738be"
server_key_version: "encryptionkey@0"
I20260929 06:37:39.363595 29750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:39.374181 29750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:39.376073 29750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:39.376197 29750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:39.379843 29750 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42299
I20260929 06:37:39.379899 29817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42299 every 8 connection(s)
I20260929 06:37:39.380316 29750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:39.381325 29818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:39.383481 29818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6: Bootstrap starting.
I20260929 06:37:39.383873 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 29750
I20260929 06:37:39.384013 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:39.384114 29818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:39.384274 9461 external_mini_cluster.cc:1428] Setting key 18b586c221abb456ec6788976fd43543
I20260929 06:37:39.384473 29818 log.cc:824] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:39.385396 29818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6: No bootstrap required, opened a new log
I20260929 06:37:39.387537 29818 raft_consensus.cc:348] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db83ba88f9d04b36bad01c245ba367f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42299 } }
I20260929 06:37:39.387728 29818 raft_consensus.cc:374] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:39.387760 29818 raft_consensus.cc:729] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db83ba88f9d04b36bad01c245ba367f6, State: Initialized, Role: FOLLOWER
I20260929 06:37:39.387877 29818 consensus_queue.cc:260] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db83ba88f9d04b36bad01c245ba367f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42299 } }
I20260929 06:37:39.387995 29818 raft_consensus.cc:388] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:39.388028 29818 raft_consensus.cc:482] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:39.388069 29818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:39.388609 29818 raft_consensus.cc:504] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db83ba88f9d04b36bad01c245ba367f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42299 } }
I20260929 06:37:39.388710 29818 leader_election.cc:302] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db83ba88f9d04b36bad01c245ba367f6; no voters:
I20260929 06:37:39.388861 29818 leader_election.cc:288] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:39.388924 29823 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:39.389106 29818 sys_catalog.cc:564] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:39.389104 29823 raft_consensus.cc:686] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [term 1 LEADER]: Becoming Leader. State: Replica: db83ba88f9d04b36bad01c245ba367f6, State: Running, Role: LEADER
I20260929 06:37:39.389586 29823 consensus_queue.cc:237] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db83ba88f9d04b36bad01c245ba367f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42299 } }
I20260929 06:37:39.390015 29825 sys_catalog.cc:455] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db83ba88f9d04b36bad01c245ba367f6. Latest consensus state: current_term: 1 leader_uuid: "db83ba88f9d04b36bad01c245ba367f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db83ba88f9d04b36bad01c245ba367f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42299 } } }
I20260929 06:37:39.390096 29825 sys_catalog.cc:458] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:39.390106 29822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:39.384812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48969 (local address 127.0.0.1:42299)
0929 06:37:39.384992 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:39.385001 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:39.385038 (+ 37us) server_negotiation.cc:407] Connection header received
0929 06:37:39.385581 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:39.385589 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:39.385638 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:39.385757 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:39.385993 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:39.386845 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:39.387998 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:39.388406 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:39.388490 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:39.389324 (+ 834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:39.389328 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:39.389328 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:39.389530 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:39.389568 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:39.389582 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:39.389673 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:39.389863 (+ 190us) server_negotiation.cc:299] Negotiation successful
0929 06:37:39.389897 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":72,"threads_started":1}
I20260929 06:37:39.390180 29824 sys_catalog.cc:455] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db83ba88f9d04b36bad01c245ba367f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db83ba88f9d04b36bad01c245ba367f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42299 } } }
I20260929 06:37:39.390242 29824 sys_catalog.cc:458] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:39.390543 29835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:39.391172 29835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:39.391182 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:39.392902 29835 catalog_manager.cc:1347] Generated new cluster ID: e0a0eb9f38634bdfafb224ad11df4b1b
I20260929 06:37:39.392959 29835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:39.399236 29822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:39.393072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42063 (local address 127.0.0.1:42299)
0929 06:37:39.393106 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:39.393107 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:39.396224 (+ 3117us) server_negotiation.cc:407] Connection header received
0929 06:37:39.396302 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:39.396303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:39.396313 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:39.396369 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:39.396515 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:39.397018 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:39.397776 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:39.398090 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:39.398158 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:39.398966 (+ 808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:39.398967 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:39.398968 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:39.398973 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:39.398988 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:39.398992 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:39.399046 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:39.399115 (+ 69us) server_negotiation.cc:299] Negotiation successful
0929 06:37:39.399126 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:37:39.432904 29835 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:39.433497 29835 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:39.446898 29835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db83ba88f9d04b36bad01c245ba367f6: Generated new TSK 0
I20260929 06:37:39.447111 29835 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:39.450486 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 29750
W20260929 06:37:39.454711 29735 connection.cc:535] client connection to 127.0.0.1:42299 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42299): Connection reset by peer (error 104)
2026-09-29T06:37:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1352 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:39 dist-test-slave-601b krb5kdc[29849](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:39 dist-test-slave-601b krb5kdc[29849](info): set up 2 sockets
Sep 29 06:37:39 dist-test-slave-601b krb5kdc[29849](info): commencing operation
krb5kdc: starting...
W20260929 06:37:40.488047 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:40 dist-test-slave-601b krb5kdc[29849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:37:40.604902 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41117
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:40.684652 29862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:40.684856 29862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:40.684880 29862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:40.685956 29862 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:40.685989 29862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:40.686003 29862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:40.686015 29862 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:40.686028 29862 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:40.687402 29862 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41117
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:40.687588 29862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:40.687762 29862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:40.692627 29870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:40.692643 29867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:40.692669 29868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:40.692984 29862 server_base.cc:1034] running on GCE node
I20260929 06:37:40.693230 29862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:40.693481 29862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:40.694653 29862 hybrid_clock.cc:648] HybridClock initialized: now 1790663860694631 us; error 35 us; skew 500 ppm
Sep 29 06:37:40 dist-test-slave-601b krb5kdc[29849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663860, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:40.697211 29862 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:37:40.697652 29862 webserver.cc:460] Webserver started at http://127.0.0.1:41267/ using document root <none> and password file <none>
I20260929 06:37:40.697845 29862 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:40.697886 29862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:40.697975 29862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:40.698966 29862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "3cb5ec0aa424460886b89995563e508a"
format_stamp: "Formatted at 2026-09-29 06:37:40 on dist-test-slave-601b"
server_key: "4290fe745ba9eebeab2591cf7bbe28db"
server_key_iv: "9cb9622b6314d5ecf1456aee2ad15541"
server_key_version: "encryptionkey@0"
I20260929 06:37:40.699332 29862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "3cb5ec0aa424460886b89995563e508a"
format_stamp: "Formatted at 2026-09-29 06:37:40 on dist-test-slave-601b"
server_key: "4290fe745ba9eebeab2591cf7bbe28db"
server_key_iv: "9cb9622b6314d5ecf1456aee2ad15541"
server_key_version: "encryptionkey@0"
I20260929 06:37:40.700697 29862 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:37:40.701401 29877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:40.701665 29862 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:37:40.701751 29862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "3cb5ec0aa424460886b89995563e508a"
format_stamp: "Formatted at 2026-09-29 06:37:40 on dist-test-slave-601b"
server_key: "4290fe745ba9eebeab2591cf7bbe28db"
server_key_iv: "9cb9622b6314d5ecf1456aee2ad15541"
server_key_version: "encryptionkey@0"
I20260929 06:37:40.701843 29862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:40.705073 29862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:40.707405 29862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:40.707556 29862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:40.711280 29862 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41117
I20260929 06:37:40.711354 29929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41117 every 8 connection(s)
I20260929 06:37:40.711683 29862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:40.712670 29930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:40.714833 29930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a: Bootstrap starting.
I20260929 06:37:40.715355 29930 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:40.715579 29930 log.cc:824] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:40.716274 29930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a: No bootstrap required, opened a new log
I20260929 06:37:40.717790 29930 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cb5ec0aa424460886b89995563e508a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41117 } }
I20260929 06:37:40.717922 29930 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:40.717944 29930 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb5ec0aa424460886b89995563e508a, State: Initialized, Role: FOLLOWER
I20260929 06:37:40.718084 29930 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cb5ec0aa424460886b89995563e508a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41117 } }
I20260929 06:37:40.718165 29930 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:40.718190 29930 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:40.718219 29930 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:40.718725 29930 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cb5ec0aa424460886b89995563e508a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41117 } }
I20260929 06:37:40.718809 29930 leader_election.cc:302] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cb5ec0aa424460886b89995563e508a; no voters:
I20260929 06:37:40.718946 29930 leader_election.cc:288] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:40.719022 29933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:40.719190 29933 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [term 1 LEADER]: Becoming Leader. State: Replica: 3cb5ec0aa424460886b89995563e508a, State: Running, Role: LEADER
I20260929 06:37:40.719231 29930 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:40.719280 29933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cb5ec0aa424460886b89995563e508a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41117 } }
I20260929 06:37:40.719691 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 29862
I20260929 06:37:40.719838 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:40.720068 9461 external_mini_cluster.cc:1428] Setting key 68bad45e7183c494810fbbe5519402f1
I20260929 06:37:40.720197 29934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cb5ec0aa424460886b89995563e508a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cb5ec0aa424460886b89995563e508a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41117 } } }
I20260929 06:37:40.720273 29934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:40.720592 29942 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:40.720645 29935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cb5ec0aa424460886b89995563e508a. Latest consensus state: current_term: 1 leader_uuid: "3cb5ec0aa424460886b89995563e508a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cb5ec0aa424460886b89995563e508a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41117 } } }
I20260929 06:37:40.720709 29935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:40.721163 29942 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:40.722787 29942 catalog_manager.cc:1347] Generated new cluster ID: e974dd5881674eb18afda6ab5a224073
I20260929 06:37:40.722843 29942 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:40.723222 29948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:40.720741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42313 (local address 127.0.0.1:41117)
0929 06:37:40.721307 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:40.721317 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:40.721354 (+ 37us) server_negotiation.cc:407] Connection header received
0929 06:37:40.721516 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:40.721564 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:40.721618 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:40.721783 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:40.722581 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:40.722586 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:40.722586 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:40.722591 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:40.722643 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:40.722658 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:40.722732 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:40.722986 (+ 254us) server_negotiation.cc:299] Negotiation successful
0929 06:37:40.723036 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":65,"threads_started":1}
I20260929 06:37:40.724323 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:40.731354 29942 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:40.731500 29942 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:40.732803 29948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:40.725729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57087 (local address 127.0.0.1:41117)
0929 06:37:40.725769 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:40.725771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:40.731018 (+ 5247us) server_negotiation.cc:407] Connection header received
0929 06:37:40.731080 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:40.731081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:40.731087 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:40.731151 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:40.732574 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:40.732576 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:40.732576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:40.732581 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:40.732596 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:40.732601 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:40.732652 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:40.732704 (+ 52us) server_negotiation.cc:299] Negotiation successful
0929 06:37:40.732719 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:37:40.740016 29942 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3cb5ec0aa424460886b89995563e508a: Generated new TSK 0
I20260929 06:37:40.740278 29942 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:40.749150 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 29862
2026-09-29T06:37:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1298 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:40 dist-test-slave-601b krb5kdc[29961](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:40 dist-test-slave-601b krb5kdc[29961](info): set up 2 sockets
Sep 29 06:37:40 dist-test-slave-601b krb5kdc[29961](info): commencing operation
krb5kdc: starting...
W20260929 06:37:41.780155 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:41 dist-test-slave-601b krb5kdc[29961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:37:41.896342 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38971
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38971
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:41.994319 29974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:41.994539 29974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:41.994563 29974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:41.996439 29974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:41.996522 29974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:41.996549 29974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:41.996596 29974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:41.996624 29974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:41.999223 29974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38971
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:41.999663 29974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:41.999956 29974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:42.005294 29979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:42.005335 29974 server_base.cc:1034] running on GCE node
W20260929 06:37:42.005294 29980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:42.005532 29982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:42.005801 29974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:42.006071 29974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:42.007220 29974 hybrid_clock.cc:648] HybridClock initialized: now 1790663862007200 us; error 28 us; skew 500 ppm
Sep 29 06:37:42 dist-test-slave-601b krb5kdc[29961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663862, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:42.009698 29974 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:37:42.010182 29974 webserver.cc:460] Webserver started at http://127.0.0.1:35951/ using document root <none> and password file <none>
I20260929 06:37:42.010408 29974 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:42.010478 29974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:42.010629 29974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:42.011724 29974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "3db4c5e48a0c45bcb82435b3d36d1099"
format_stamp: "Formatted at 2026-09-29 06:37:42 on dist-test-slave-601b"
server_key: "1a7f9a037bbc777a830adbf00b4fbecf"
server_key_iv: "2f426243080973319aae5c442659cc38"
server_key_version: "encryptionkey@0"
I20260929 06:37:42.012125 29974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "3db4c5e48a0c45bcb82435b3d36d1099"
format_stamp: "Formatted at 2026-09-29 06:37:42 on dist-test-slave-601b"
server_key: "1a7f9a037bbc777a830adbf00b4fbecf"
server_key_iv: "2f426243080973319aae5c442659cc38"
server_key_version: "encryptionkey@0"
I20260929 06:37:42.013410 29974 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260929 06:37:42.014154 29989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:42.014326 29974 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260929 06:37:42.014422 29974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "3db4c5e48a0c45bcb82435b3d36d1099"
format_stamp: "Formatted at 2026-09-29 06:37:42 on dist-test-slave-601b"
server_key: "1a7f9a037bbc777a830adbf00b4fbecf"
server_key_iv: "2f426243080973319aae5c442659cc38"
server_key_version: "encryptionkey@0"
I20260929 06:37:42.014500 29974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:42.022014 29974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:42.023756 29974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:42.023916 29974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:42.027827 29974 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38971
I20260929 06:37:42.027858 30041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38971 every 8 connection(s)
I20260929 06:37:42.028239 29974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:42.029206 30042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:42.031052 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 29974
I20260929 06:37:42.031193 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:42.031376 9461 external_mini_cluster.cc:1428] Setting key 3055b02951965d50a920f1da216594e5
I20260929 06:37:42.031759 30042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099: Bootstrap starting.
I20260929 06:37:42.032457 30042 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:42.032755 30042 log.cc:824] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:42.033509 30042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099: No bootstrap required, opened a new log
I20260929 06:37:42.035856 30042 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db4c5e48a0c45bcb82435b3d36d1099" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38971 } }
I20260929 06:37:42.036047 30042 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:42.036082 30042 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3db4c5e48a0c45bcb82435b3d36d1099, State: Initialized, Role: FOLLOWER
I20260929 06:37:42.036212 30042 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db4c5e48a0c45bcb82435b3d36d1099" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38971 } }
I20260929 06:37:42.036288 30042 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:42.036319 30042 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:42.036366 30042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:42.037112 30042 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db4c5e48a0c45bcb82435b3d36d1099" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38971 } }
I20260929 06:37:42.037259 30042 leader_election.cc:302] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3db4c5e48a0c45bcb82435b3d36d1099; no voters:
I20260929 06:37:42.037448 30042 leader_election.cc:288] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:42.037488 30047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:42.037719 30047 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [term 1 LEADER]: Becoming Leader. State: Replica: 3db4c5e48a0c45bcb82435b3d36d1099, State: Running, Role: LEADER
I20260929 06:37:42.037756 30042 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [sys.catalog]: configured and running, proceeding with master startup.
Sep 29 06:37:42 dist-test-slave-601b krb5kdc[29961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 06:37:42.039072 30047 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db4c5e48a0c45bcb82435b3d36d1099" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38971 } }
I20260929 06:37:42.039708 30049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3db4c5e48a0c45bcb82435b3d36d1099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db4c5e48a0c45bcb82435b3d36d1099" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38971 } } }
I20260929 06:37:42.040062 30049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:42.039832 30048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3db4c5e48a0c45bcb82435b3d36d1099. Latest consensus state: current_term: 1 leader_uuid: "3db4c5e48a0c45bcb82435b3d36d1099" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db4c5e48a0c45bcb82435b3d36d1099" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38971 } } }
W20260929 06:37:42.040164 30061 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:37:42.040234 30061 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:37:42.040196 30048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:42.040367 30063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:42.040520 30063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:42.042076 30063 catalog_manager.cc:1347] Generated new cluster ID: 6b8b76d8d95a4026a5069354ee222677
I20260929 06:37:42.042126 30063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:42.043130 30045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:42.031922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43887 (local address 127.0.0.1:38971)
0929 06:37:42.032133 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:42.032142 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:42.032172 (+ 30us) server_negotiation.cc:407] Connection header received
0929 06:37:42.032645 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:42.032654 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:42.032714 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:42.032864 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:42.033584 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:42.034971 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:42.035737 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:42.036366 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:42.036482 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:42.039408 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:42.039412 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:42.039413 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:42.039425 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:42.041378 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:42.041814 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:42.041817 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:42.041817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:42.041913 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:42.042219 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:42.042220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:42.042220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:42.042513 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:42.042629 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:42.042822 (+ 193us) server_negotiation.cc:299] Negotiation successful
0929 06:37:42.042947 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":106,"threads_started":1}
I20260929 06:37:42.044209 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:42.052951 30045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:42.045723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42829 (local address 127.0.0.1:38971)
0929 06:37:42.045760 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:42.045762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:42.045860 (+ 98us) server_negotiation.cc:407] Connection header received
0929 06:37:42.045919 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:42.045920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:42.045928 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:42.045981 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:42.046677 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:42.047386 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:42.048465 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:42.048782 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:42.048842 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:42.050196 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:42.050197 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:42.050198 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:42.050204 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:42.051767 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:42.052192 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:42.052194 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:42.052194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:42.052249 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:42.052458 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:42.052458 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:42.052459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:42.052569 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:42.052653 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:42.052794 (+ 141us) server_negotiation.cc:299] Negotiation successful
0929 06:37:42.052866 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:37:42.061268 30063 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:42.061896 30063 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:42.065016 30063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3db4c5e48a0c45bcb82435b3d36d1099: Generated new TSK 0
I20260929 06:37:42.065212 30063 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:42.070021 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 29974
2026-09-29T06:37:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1320 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:42 dist-test-slave-601b krb5kdc[30073](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:42 dist-test-slave-601b krb5kdc[30073](info): set up 2 sockets
Sep 29 06:37:42 dist-test-slave-601b krb5kdc[30073](info): commencing operation
krb5kdc: starting...
W20260929 06:37:43.160455 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:43 dist-test-slave-601b krb5kdc[30073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:37:43.276954 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41685
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:43.357395 30086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:43.357595 30086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:43.357618 30086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:43.358678 30086 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:43.358719 30086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:43.358733 30086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:43.358747 30086 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:43.358758 30086 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:43.360167 30086 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:43.360358 30086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:43.360518 30086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:43.365298 30094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:43.365407 30086 server_base.cc:1034] running on GCE node
W20260929 06:37:43.365314 30091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:43.365307 30092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:43.365797 30086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:43.366091 30086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:43.367276 30086 hybrid_clock.cc:648] HybridClock initialized: now 1790663863367278 us; error 44 us; skew 500 ppm
Sep 29 06:37:43 dist-test-slave-601b krb5kdc[30073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663863, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:43.369737 30086 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:37:43.370203 30086 webserver.cc:460] Webserver started at http://127.0.0.1:43163/ using document root <none> and password file <none>
I20260929 06:37:43.370393 30086 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:43.370433 30086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:43.370520 30086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:43.371495 30086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "9a4af86aa15a45b4b4c9f2747f62341f"
format_stamp: "Formatted at 2026-09-29 06:37:43 on dist-test-slave-601b"
server_key: "0b17404deca1de6cfc471997fcbfcd0f"
server_key_iv: "a8a57074c80f775e1fd0b6690e22fdc3"
server_key_version: "encryptionkey@0"
I20260929 06:37:43.371788 30086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "9a4af86aa15a45b4b4c9f2747f62341f"
format_stamp: "Formatted at 2026-09-29 06:37:43 on dist-test-slave-601b"
server_key: "0b17404deca1de6cfc471997fcbfcd0f"
server_key_iv: "a8a57074c80f775e1fd0b6690e22fdc3"
server_key_version: "encryptionkey@0"
I20260929 06:37:43.373150 30086 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:37:43.373934 30101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:43.374166 30086 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:43.374277 30086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "9a4af86aa15a45b4b4c9f2747f62341f"
format_stamp: "Formatted at 2026-09-29 06:37:43 on dist-test-slave-601b"
server_key: "0b17404deca1de6cfc471997fcbfcd0f"
server_key_iv: "a8a57074c80f775e1fd0b6690e22fdc3"
server_key_version: "encryptionkey@0"
I20260929 06:37:43.374360 30086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:43.391270 30086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:43.393416 30086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:43.393608 30086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:43.398029 30086 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41685
I20260929 06:37:43.398065 30153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41685 every 8 connection(s)
I20260929 06:37:43.398440 30086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:43.399449 30154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:43.401691 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 30086
I20260929 06:37:43.401823 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:43.402026 9461 external_mini_cluster.cc:1428] Setting key 213d6a67c68bf446d66d33bdd695e725
I20260929 06:37:43.402081 30154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f: Bootstrap starting.
I20260929 06:37:43.402806 30154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:43.403119 30154 log.cc:824] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:43.403872 30154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f: No bootstrap required, opened a new log
I20260929 06:37:43.406136 30154 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a4af86aa15a45b4b4c9f2747f62341f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41685 } }
I20260929 06:37:43.406306 30154 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:43.406337 30154 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a4af86aa15a45b4b4c9f2747f62341f, State: Initialized, Role: FOLLOWER
I20260929 06:37:43.406451 30154 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a4af86aa15a45b4b4c9f2747f62341f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41685 } }
I20260929 06:37:43.406522 30154 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:43.406551 30154 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:43.406597 30154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:43.407316 30154 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a4af86aa15a45b4b4c9f2747f62341f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41685 } }
I20260929 06:37:43.407433 30154 leader_election.cc:302] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a4af86aa15a45b4b4c9f2747f62341f; no voters:
I20260929 06:37:43.407601 30154 leader_election.cc:288] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:43.407634 30159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:43.407819 30159 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [term 1 LEADER]: Becoming Leader. State: Replica: 9a4af86aa15a45b4b4c9f2747f62341f, State: Running, Role: LEADER
I20260929 06:37:43.407867 30154 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:43.407934 30159 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a4af86aa15a45b4b4c9f2747f62341f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41685 } }
I20260929 06:37:43.408397 30159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a4af86aa15a45b4b4c9f2747f62341f. Latest consensus state: current_term: 1 leader_uuid: "9a4af86aa15a45b4b4c9f2747f62341f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a4af86aa15a45b4b4c9f2747f62341f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41685 } } }
I20260929 06:37:43.408521 30160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a4af86aa15a45b4b4c9f2747f62341f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a4af86aa15a45b4b4c9f2747f62341f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41685 } } }
I20260929 06:37:43.408645 30160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:43.408545 30159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:43.409040 30168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:43.409539 30168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:43.408452 30157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:43.402560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59709 (local address 127.0.0.1:41685)
0929 06:37:43.402778 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:43.402788 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:43.402822 (+ 34us) server_negotiation.cc:407] Connection header received
0929 06:37:43.403444 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:43.403451 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:43.403500 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:43.403675 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:43.403884 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:43.405334 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:43.406134 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:43.406744 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:43.406857 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:43.407612 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:43.407616 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:43.407616 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:43.407832 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:43.407873 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:43.407888 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:43.407947 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:43.408140 (+ 193us) server_negotiation.cc:299] Negotiation successful
0929 06:37:43.408212 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":89,"threads_started":1}
I20260929 06:37:43.411051 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:43.411134 30168 catalog_manager.cc:1347] Generated new cluster ID: ba601dd7c2fa40bc88348d7564b98073
I20260929 06:37:43.411186 30168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:43.418742 30157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:43.416051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45175 (local address 127.0.0.1:41685)
0929 06:37:43.416095 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:43.416097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:43.416106 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:37:43.416126 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:43.416127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:43.416136 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:43.416224 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:43.416358 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:43.416823 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:43.417550 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:43.417752 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:43.417830 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:43.418500 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:43.418507 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:43.418508 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:43.418512 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:43.418525 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:43.418529 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:43.418583 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:43.418645 (+ 62us) server_negotiation.cc:299] Negotiation successful
0929 06:37:43.418665 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:37:43.419600 30168 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:43.420328 30168 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:43.428998 30168 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a4af86aa15a45b4b4c9f2747f62341f: Generated new TSK 0
I20260929 06:37:43.429175 30168 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:43.433306 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 30086
2026-09-29T06:37:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1362 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:43 dist-test-slave-601b krb5kdc[30185](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:43 dist-test-slave-601b krb5kdc[30185](info): set up 2 sockets
Sep 29 06:37:43 dist-test-slave-601b krb5kdc[30185](info): commencing operation
krb5kdc: starting...
W20260929 06:37:44.484042 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.033s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:44 dist-test-slave-601b krb5kdc[30185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:37:44.601138 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43733
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:44.682808 30198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:44.683064 30198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:44.683111 30198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:44.684332 30198 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:44.684396 30198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:44.684422 30198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:44.684449 30198 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:44.684481 30198 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:44.685978 30198 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43733
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:44.686262 30198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:44.686492 30198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:44.691425 30203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:44.691447 30206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:44.691676 30198 server_base.cc:1034] running on GCE node
W20260929 06:37:44.691443 30204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:44.692008 30198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:44.692270 30198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:44.693413 30198 hybrid_clock.cc:648] HybridClock initialized: now 1790663864693406 us; error 38 us; skew 500 ppm
Sep 29 06:37:44 dist-test-slave-601b krb5kdc[30185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663864, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:44.701601 30198 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:37:44.702075 30198 webserver.cc:460] Webserver started at http://127.0.0.1:40911/ using document root <none> and password file <none>
I20260929 06:37:44.702320 30198 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:44.702368 30198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:44.702540 30198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:44.703619 30198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "a1077a4115c54a329abf2c64a6fdaa85"
format_stamp: "Formatted at 2026-09-29 06:37:44 on dist-test-slave-601b"
server_key: "138eb9981ec81d5472b34ad46321647c"
server_key_iv: "f5a9169862b9dde2219989a3d03b4b1e"
server_key_version: "encryptionkey@0"
I20260929 06:37:44.704088 30198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "a1077a4115c54a329abf2c64a6fdaa85"
format_stamp: "Formatted at 2026-09-29 06:37:44 on dist-test-slave-601b"
server_key: "138eb9981ec81d5472b34ad46321647c"
server_key_iv: "f5a9169862b9dde2219989a3d03b4b1e"
server_key_version: "encryptionkey@0"
I20260929 06:37:44.705462 30198 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:44.706264 30213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:44.706441 30198 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:44.706544 30198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "a1077a4115c54a329abf2c64a6fdaa85"
format_stamp: "Formatted at 2026-09-29 06:37:44 on dist-test-slave-601b"
server_key: "138eb9981ec81d5472b34ad46321647c"
server_key_iv: "f5a9169862b9dde2219989a3d03b4b1e"
server_key_version: "encryptionkey@0"
I20260929 06:37:44.706630 30198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:44.709945 30198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:44.711882 30198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:44.712078 30198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:44.716176 30198 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43733
I20260929 06:37:44.716226 30265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43733 every 8 connection(s)
I20260929 06:37:44.716539 30198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:44.717468 30266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:44.719673 30266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85: Bootstrap starting.
I20260929 06:37:44.720319 30266 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:44.720599 30266 log.cc:824] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:44.721292 30266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85: No bootstrap required, opened a new log
I20260929 06:37:44.722883 30266 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1077a4115c54a329abf2c64a6fdaa85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43733 } }
I20260929 06:37:44.723013 30266 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:44.723057 30266 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1077a4115c54a329abf2c64a6fdaa85, State: Initialized, Role: FOLLOWER
I20260929 06:37:44.723217 30266 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1077a4115c54a329abf2c64a6fdaa85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43733 } }
I20260929 06:37:44.723299 30266 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:44.723343 30266 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:44.723393 30266 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:44.723901 30266 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1077a4115c54a329abf2c64a6fdaa85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43733 } }
I20260929 06:37:44.724077 30266 leader_election.cc:302] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1077a4115c54a329abf2c64a6fdaa85; no voters:
I20260929 06:37:44.724248 30266 leader_election.cc:288] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:44.724298 30269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:44.724475 30269 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [term 1 LEADER]: Becoming Leader. State: Replica: a1077a4115c54a329abf2c64a6fdaa85, State: Running, Role: LEADER
I20260929 06:37:44.724519 30266 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:44.724638 30269 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1077a4115c54a329abf2c64a6fdaa85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43733 } }
I20260929 06:37:44.725032 30271 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1077a4115c54a329abf2c64a6fdaa85. Latest consensus state: current_term: 1 leader_uuid: "a1077a4115c54a329abf2c64a6fdaa85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1077a4115c54a329abf2c64a6fdaa85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43733 } } }
I20260929 06:37:44.725109 30271 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:44.725183 30270 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1077a4115c54a329abf2c64a6fdaa85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1077a4115c54a329abf2c64a6fdaa85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43733 } } }
I20260929 06:37:44.725267 30270 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:44.725582 30277 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:44.725761 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 30198
I20260929 06:37:44.725888 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:44.726089 9461 external_mini_cluster.cc:1428] Setting key 39a493b234e2377e589960fe490b4e56
I20260929 06:37:44.726186 30277 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:44.727691 30277 catalog_manager.cc:1347] Generated new cluster ID: 11b9c01217f14e39b1a85ddc44876815
I20260929 06:37:44.727764 30277 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:44.729604 30287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:44.726564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48281 (local address 127.0.0.1:43733)
0929 06:37:44.727136 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:44.727145 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:44.728181 (+ 1036us) server_negotiation.cc:407] Connection header received
0929 06:37:44.728307 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:44.728314 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:44.728344 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:44.728483 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:44.729189 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:44.729192 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:44.729192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:44.729196 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:44.729237 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:44.729250 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:44.729311 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:44.729402 (+ 91us) server_negotiation.cc:299] Negotiation successful
0929 06:37:44.729439 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":68,"threads_started":1}
I20260929 06:37:44.730531 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:44.733135 30287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:44.732096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34649 (local address 127.0.0.1:43733)
0929 06:37:44.732132 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:44.732134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:44.732147 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:37:44.732219 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:44.732220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:44.732225 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:44.732282 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:44.732925 (+ 643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:44.732926 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:44.732926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:44.732930 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:44.732947 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:44.732951 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:44.733007 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:44.733061 (+ 54us) server_negotiation.cc:299] Negotiation successful
0929 06:37:44.733075 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:37:44.741930 30277 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:44.742121 30277 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:44.745112 30277 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1077a4115c54a329abf2c64a6fdaa85: Generated new TSK 0
I20260929 06:37:44.745309 30277 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:44.755553 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 30198
2026-09-29T06:37:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1322 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:44 dist-test-slave-601b krb5kdc[30297](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:44 dist-test-slave-601b krb5kdc[30297](info): set up 2 sockets
Sep 29 06:37:44 dist-test-slave-601b krb5kdc[30297](info): commencing operation
krb5kdc: starting...
W20260929 06:37:45.784101 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:45 dist-test-slave-601b krb5kdc[30297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:37:45.902187 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40569
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:45.982393 30310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:45.982631 30310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:45.982668 30310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:45.983814 30310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:45.983884 30310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:45.983909 30310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:45.983940 30310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:45.983989 30310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:45.985453 30310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:45.985733 30310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:45.985958 30310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:45.990782 30315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:45.990823 30318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:45.990823 30316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:45.990937 30310 server_base.cc:1034] running on GCE node
I20260929 06:37:45.991242 30310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:45.991528 30310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:45.992687 30310 hybrid_clock.cc:648] HybridClock initialized: now 1790663865992674 us; error 46 us; skew 500 ppm
Sep 29 06:37:45 dist-test-slave-601b krb5kdc[30297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663865, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:45.995142 30310 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:37:45.995720 30310 webserver.cc:460] Webserver started at http://127.0.0.1:38493/ using document root <none> and password file <none>
I20260929 06:37:45.996033 30310 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:45.996095 30310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:45.996243 30310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:45.997889 30310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "ee6615725c2541e397fd6200b03563f7"
format_stamp: "Formatted at 2026-09-29 06:37:45 on dist-test-slave-601b"
server_key: "c52d6d26aa9eb2f3f54577aabddcb858"
server_key_iv: "964e183098d7b806ceed69ebbc7adce0"
server_key_version: "encryptionkey@0"
I20260929 06:37:45.998392 30310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "ee6615725c2541e397fd6200b03563f7"
format_stamp: "Formatted at 2026-09-29 06:37:45 on dist-test-slave-601b"
server_key: "c52d6d26aa9eb2f3f54577aabddcb858"
server_key_iv: "964e183098d7b806ceed69ebbc7adce0"
server_key_version: "encryptionkey@0"
I20260929 06:37:46.000087 30310 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260929 06:37:46.001107 30325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:46.001294 30310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:46.001385 30310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "ee6615725c2541e397fd6200b03563f7"
format_stamp: "Formatted at 2026-09-29 06:37:45 on dist-test-slave-601b"
server_key: "c52d6d26aa9eb2f3f54577aabddcb858"
server_key_iv: "964e183098d7b806ceed69ebbc7adce0"
server_key_version: "encryptionkey@0"
I20260929 06:37:46.001456 30310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:46.020828 30310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:46.023216 30310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:46.023365 30310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:46.027562 30310 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40569
I20260929 06:37:46.027645 30377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40569 every 8 connection(s)
I20260929 06:37:46.027995 30310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:46.028944 30378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:46.031199 30378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7: Bootstrap starting.
I20260929 06:37:46.031790 30378 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:46.032104 30378 log.cc:824] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:46.032866 30378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7: No bootstrap required, opened a new log
I20260929 06:37:46.034664 30378 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6615725c2541e397fd6200b03563f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40569 } }
I20260929 06:37:46.034816 30378 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:46.034839 30378 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6615725c2541e397fd6200b03563f7, State: Initialized, Role: FOLLOWER
I20260929 06:37:46.035043 30378 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6615725c2541e397fd6200b03563f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40569 } }
I20260929 06:37:46.035133 30378 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:46.035182 30378 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:46.035238 30378 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:46.035795 30378 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6615725c2541e397fd6200b03563f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40569 } }
I20260929 06:37:46.035924 30378 leader_election.cc:302] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee6615725c2541e397fd6200b03563f7; no voters:
I20260929 06:37:46.036157 30378 leader_election.cc:288] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:46.036206 30381 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:46.036369 30381 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [term 1 LEADER]: Becoming Leader. State: Replica: ee6615725c2541e397fd6200b03563f7, State: Running, Role: LEADER
I20260929 06:37:46.036439 30378 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:46.036459 30381 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6615725c2541e397fd6200b03563f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40569 } }
I20260929 06:37:46.036864 30383 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee6615725c2541e397fd6200b03563f7. Latest consensus state: current_term: 1 leader_uuid: "ee6615725c2541e397fd6200b03563f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6615725c2541e397fd6200b03563f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40569 } } }
I20260929 06:37:46.036952 30383 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:46.036959 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 30310
I20260929 06:37:46.037083 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:46.037181 30382 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee6615725c2541e397fd6200b03563f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6615725c2541e397fd6200b03563f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40569 } } }
I20260929 06:37:46.037304 9461 external_mini_cluster.cc:1428] Setting key ef07470c80b498d9df6f5d8097f69272
I20260929 06:37:46.037333 30382 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7 [sys.catalog]: This master's current role is: LEADER
W20260929 06:37:46.038513 30399 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:37:46.038578 30399 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:37:46.038643 30387 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:46.038818 30387 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:46.040328 30387 catalog_manager.cc:1347] Generated new cluster ID: 557a0d338dd94492b35c1a06315e6789
I20260929 06:37:46.040376 30387 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:37:46 dist-test-slave-601b krb5kdc[30297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 06:37:46.050089 30387 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:46.050585 30387 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:46.050632 30398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:46.037769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.65:44361 (local address 127.0.0.1:40569)
0929 06:37:46.037986 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:46.037996 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:46.038031 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:37:46.038190 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:46.038197 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:46.038262 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:46.038428 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:46.039298 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:46.040624 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:46.041825 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:46.042408 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:46.042495 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:46.045495 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:46.045500 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:46.045501 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:46.045514 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:46.048365 (+ 2851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:46.048820 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:46.048823 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:46.048824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:46.048951 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:46.049214 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:46.049215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:46.049215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:46.049564 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:46.050156 (+ 592us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:46.050256 (+ 100us) server_negotiation.cc:299] Negotiation successful
0929 06:37:46.050370 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":80,"threads_started":1}
I20260929 06:37:46.051692 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:46.058866 30387 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee6615725c2541e397fd6200b03563f7: Generated new TSK 0
I20260929 06:37:46.059055 30387 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:46.064158 30398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:46.056278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.65:51907 (local address 127.0.0.1:40569)
0929 06:37:46.056319 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:46.056321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:46.056533 (+ 212us) server_negotiation.cc:407] Connection header received
0929 06:37:46.056594 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:46.056594 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:46.056605 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:46.056655 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:46.057356 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:46.058149 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:46.059313 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:46.059867 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:46.059922 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:46.061459 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:46.061460 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:46.061460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:46.061466 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:46.062890 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:46.063333 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:46.063333 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:46.063334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:46.063382 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:46.063634 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:46.063634 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:46.063635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:46.063724 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:46.063796 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:46.064025 (+ 229us) server_negotiation.cc:299] Negotiation successful
0929 06:37:46.064074 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:37:46.066238 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 30310
W20260929 06:37:46.070789 30295 connection.cc:535] client connection to 127.0.0.1:40569 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40569): Connection reset by peer (error 104)
2026-09-29T06:37:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1311 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:46 dist-test-slave-601b krb5kdc[30409](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:46 dist-test-slave-601b krb5kdc[30409](info): set up 2 sockets
Sep 29 06:37:46 dist-test-slave-601b krb5kdc[30409](info): commencing operation
krb5kdc: starting...
W20260929 06:37:47.088091 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.004s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:47 dist-test-slave-601b krb5kdc[30409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:37:47.206270 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46189
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46189
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:47.286763 30422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:47.287011 30422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:47.287052 30422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:47.288251 30422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:47.288323 30422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:47.288348 30422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:47.288376 30422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:47.288407 30422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:47.289903 30422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:47.290184 30422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:47.290426 30422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:47.295516 30428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:47.295486 30427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:47.295668 30422 server_base.cc:1034] running on GCE node
W20260929 06:37:47.295467 30430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:47.295994 30422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:47.296304 30422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:47.297495 30422 hybrid_clock.cc:648] HybridClock initialized: now 1790663867297475 us; error 40 us; skew 500 ppm
Sep 29 06:37:47 dist-test-slave-601b krb5kdc[30409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663867, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:47.300169 30422 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:37:47.300637 30422 webserver.cc:460] Webserver started at http://127.0.0.1:34823/ using document root <none> and password file <none>
I20260929 06:37:47.300843 30422 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:47.300884 30422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:47.300972 30422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:47.301996 30422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "b2d99efc1c18431fb2fa426b7f989649"
format_stamp: "Formatted at 2026-09-29 06:37:47 on dist-test-slave-601b"
server_key: "583cb6fc45590e62893b3d98e61b1371"
server_key_iv: "7bf89731b55ec5e18431b65704ad27e0"
server_key_version: "encryptionkey@0"
I20260929 06:37:47.302292 30422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "b2d99efc1c18431fb2fa426b7f989649"
format_stamp: "Formatted at 2026-09-29 06:37:47 on dist-test-slave-601b"
server_key: "583cb6fc45590e62893b3d98e61b1371"
server_key_iv: "7bf89731b55ec5e18431b65704ad27e0"
server_key_version: "encryptionkey@0"
I20260929 06:37:47.303543 30422 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:37:47.304325 30437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:47.304522 30422 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:47.304613 30422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "b2d99efc1c18431fb2fa426b7f989649"
format_stamp: "Formatted at 2026-09-29 06:37:47 on dist-test-slave-601b"
server_key: "583cb6fc45590e62893b3d98e61b1371"
server_key_iv: "7bf89731b55ec5e18431b65704ad27e0"
server_key_version: "encryptionkey@0"
I20260929 06:37:47.304670 30422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:47.311501 30422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:47.313400 30422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:47.313508 30422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:47.317401 30422 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46189
I20260929 06:37:47.317436 30489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46189 every 8 connection(s)
I20260929 06:37:47.317809 30422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:47.318789 30490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:47.320879 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 30422
I20260929 06:37:47.321027 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:47.321237 9461 external_mini_cluster.cc:1428] Setting key 72169cd66f732448a31117b2cc31395b
I20260929 06:37:47.321524 30490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649: Bootstrap starting.
I20260929 06:37:47.322320 30490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:47.322639 30490 log.cc:824] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:47.323563 30490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649: No bootstrap required, opened a new log
I20260929 06:37:47.325860 30490 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2d99efc1c18431fb2fa426b7f989649" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46189 } }
I20260929 06:37:47.326030 30490 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:47.326066 30490 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d99efc1c18431fb2fa426b7f989649, State: Initialized, Role: FOLLOWER
I20260929 06:37:47.326225 30490 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2d99efc1c18431fb2fa426b7f989649" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46189 } }
I20260929 06:37:47.326313 30490 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:47.326344 30490 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:47.326397 30490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:47.327160 30490 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2d99efc1c18431fb2fa426b7f989649" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46189 } }
I20260929 06:37:47.327272 30490 leader_election.cc:302] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2d99efc1c18431fb2fa426b7f989649; no voters:
I20260929 06:37:47.327443 30490 leader_election.cc:288] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:47.327467 30495 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:47.327708 30495 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [term 1 LEADER]: Becoming Leader. State: Replica: b2d99efc1c18431fb2fa426b7f989649, State: Running, Role: LEADER
I20260929 06:37:47.327787 30490 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:47.327819 30493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:47.321784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.65:46505 (local address 127.0.0.1:46189)
0929 06:37:47.322022 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:47.322034 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:47.322074 (+ 40us) server_negotiation.cc:407] Connection header received
0929 06:37:47.322713 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:47.322723 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:47.322792 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:47.322940 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:47.323303 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:47.324722 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:47.325476 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:47.326116 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:47.326229 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:47.326987 (+ 758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:47.326991 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:47.326991 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:47.327215 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:47.327257 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:47.327271 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:47.327364 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:47.327519 (+ 155us) server_negotiation.cc:299] Negotiation successful
0929 06:37:47.327549 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":115,"threads_started":1}
I20260929 06:37:47.327844 30495 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2d99efc1c18431fb2fa426b7f989649" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46189 } }
I20260929 06:37:47.328408 30497 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2d99efc1c18431fb2fa426b7f989649. Latest consensus state: current_term: 1 leader_uuid: "b2d99efc1c18431fb2fa426b7f989649" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2d99efc1c18431fb2fa426b7f989649" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46189 } } }
I20260929 06:37:47.328492 30497 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:47.328820 30504 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:47.328824 30496 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2d99efc1c18431fb2fa426b7f989649" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2d99efc1c18431fb2fa426b7f989649" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46189 } } }
I20260929 06:37:47.328953 30496 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:47.329000 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:47.329363 30504 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:47.333256 30504 catalog_manager.cc:1347] Generated new cluster ID: 9590bdc0a0a34759bcd705f33e3b8493
I20260929 06:37:47.333316 30504 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:47.336485 30493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:47.330520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.65:41455 (local address 127.0.0.1:46189)
0929 06:37:47.330555 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:47.330557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:47.330817 (+ 260us) server_negotiation.cc:407] Connection header received
0929 06:37:47.330883 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:47.330884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:47.330894 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:47.330955 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:47.331044 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:47.331763 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:47.332567 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:47.332856 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:47.332930 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:47.336220 (+ 3290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:47.336222 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:47.336222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:47.336227 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:47.336242 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:47.336249 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:47.336325 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:47.336392 (+ 67us) server_negotiation.cc:299] Negotiation successful
0929 06:37:47.336402 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:37:47.347802 30504 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:47.348563 30504 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:47.357174 30504 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2d99efc1c18431fb2fa426b7f989649: Generated new TSK 0
I20260929 06:37:47.357369 30504 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:47.362246 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 30422
W20260929 06:37:47.366650 30407 connection.cc:535] client connection to 127.0.0.1:46189 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46189): Connection reset by peer (error 104)
2026-09-29T06:37:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1295 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:47 dist-test-slave-601b krb5kdc[30521](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:47 dist-test-slave-601b krb5kdc[30521](info): set up 2 sockets
Sep 29 06:37:47 dist-test-slave-601b krb5kdc[30521](info): commencing operation
krb5kdc: starting...
W20260929 06:37:48.392584 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:48 dist-test-slave-601b krb5kdc[30521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:37:48.510911 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43331
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:48.591398 30534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:48.591619 30534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:48.591643 30534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:48.592757 30534 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:48.592793 30534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:48.592808 30534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:48.592820 30534 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:48.592832 30534 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:48.594200 30534 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:48.594393 30534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:48.594564 30534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:48.599643 30539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:48.599632 30540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:48.599632 30542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:48.599924 30534 server_base.cc:1034] running on GCE node
I20260929 06:37:48.600212 30534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:48.600517 30534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:48.601676 30534 hybrid_clock.cc:648] HybridClock initialized: now 1790663868601665 us; error 34 us; skew 500 ppm
Sep 29 06:37:48 dist-test-slave-601b krb5kdc[30521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663868, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:48.604224 30534 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:37:48.604664 30534 webserver.cc:460] Webserver started at http://127.0.0.1:40383/ using document root <none> and password file <none>
I20260929 06:37:48.604908 30534 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:48.604955 30534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:48.605124 30534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:48.606191 30534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "7e27818bb3f449b38bee8c8f78b5fcb9"
format_stamp: "Formatted at 2026-09-29 06:37:48 on dist-test-slave-601b"
server_key: "78c337a53dfb5d1cfd96b9768c8a3714"
server_key_iv: "952b61b52894aec6b63d5a98271e4a5d"
server_key_version: "encryptionkey@0"
I20260929 06:37:48.606539 30534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "7e27818bb3f449b38bee8c8f78b5fcb9"
format_stamp: "Formatted at 2026-09-29 06:37:48 on dist-test-slave-601b"
server_key: "78c337a53dfb5d1cfd96b9768c8a3714"
server_key_iv: "952b61b52894aec6b63d5a98271e4a5d"
server_key_version: "encryptionkey@0"
I20260929 06:37:48.607826 30534 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:37:48.608592 30549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:48.608762 30534 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:37:48.608877 30534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "7e27818bb3f449b38bee8c8f78b5fcb9"
format_stamp: "Formatted at 2026-09-29 06:37:48 on dist-test-slave-601b"
server_key: "78c337a53dfb5d1cfd96b9768c8a3714"
server_key_iv: "952b61b52894aec6b63d5a98271e4a5d"
server_key_version: "encryptionkey@0"
I20260929 06:37:48.608946 30534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:48.612221 30534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:48.614272 30534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:48.614459 30534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:48.618388 30534 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43331
I20260929 06:37:48.618422 30601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43331 every 8 connection(s)
I20260929 06:37:48.618743 30534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:48.619676 30602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:48.621954 30602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9: Bootstrap starting.
I20260929 06:37:48.622538 30602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:48.622829 30602 log.cc:824] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:48.623471 30602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9: No bootstrap required, opened a new log
I20260929 06:37:48.625092 30602 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e27818bb3f449b38bee8c8f78b5fcb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43331 } }
I20260929 06:37:48.625224 30602 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:48.625245 30602 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e27818bb3f449b38bee8c8f78b5fcb9, State: Initialized, Role: FOLLOWER
I20260929 06:37:48.625373 30602 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e27818bb3f449b38bee8c8f78b5fcb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43331 } }
I20260929 06:37:48.625454 30602 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:48.625478 30602 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:48.625519 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 30534
I20260929 06:37:48.625538 30602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:48.625654 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:48.625854 9461 external_mini_cluster.cc:1428] Setting key 52e91d8f17d17736d7bc935ca6a01d3e
I20260929 06:37:48.626209 30602 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e27818bb3f449b38bee8c8f78b5fcb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43331 } }
I20260929 06:37:48.626362 30602 leader_election.cc:302] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e27818bb3f449b38bee8c8f78b5fcb9; no voters:
I20260929 06:37:48.626602 30602 leader_election.cc:288] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:48.626623 30607 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:48.626727 30607 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e27818bb3f449b38bee8c8f78b5fcb9, State: Running, Role: LEADER
I20260929 06:37:48.626814 30607 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e27818bb3f449b38bee8c8f78b5fcb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43331 } }
I20260929 06:37:48.626852 30602 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:48.628058 30606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:48.626324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.65:41255 (local address 127.0.0.1:43331)
0929 06:37:48.626508 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:48.626516 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:48.626541 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:37:48.626630 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:48.626634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:48.626679 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:48.626884 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:48.627589 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:48.627592 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:48.627592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:48.627596 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:48.627641 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:48.627652 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:48.627729 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:48.627801 (+ 72us) server_negotiation.cc:299] Negotiation successful
0929 06:37:48.627844 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
I20260929 06:37:48.629022 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:48.628922 30607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e27818bb3f449b38bee8c8f78b5fcb9. Latest consensus state: current_term: 1 leader_uuid: "7e27818bb3f449b38bee8c8f78b5fcb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e27818bb3f449b38bee8c8f78b5fcb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43331 } } }
I20260929 06:37:48.630755 30607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:48.629148 30609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e27818bb3f449b38bee8c8f78b5fcb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e27818bb3f449b38bee8c8f78b5fcb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43331 } } }
I20260929 06:37:48.630951 30609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9 [sys.catalog]: This master's current role is: LEADER
W20260929 06:37:48.629535 30621 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:37:48.631057 30621 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:37:48.631150 30629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:48.631354 30629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:48.631850 30606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:48.630746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.65:47815 (local address 127.0.0.1:43331)
0929 06:37:48.630792 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:48.630794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:48.630802 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:37:48.630900 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:48.630901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:48.630919 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:48.630980 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:48.631640 (+ 660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:48.631641 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:48.631641 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:48.631645 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:48.631659 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:48.631663 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:48.631717 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:48.631775 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 06:37:48.631789 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260929 06:37:48.632838 30629 catalog_manager.cc:1347] Generated new cluster ID: dc7b8f58aad049f59c9a51f01814c0b7
I20260929 06:37:48.632898 30629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:48.656742 30629 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:48.656961 30629 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:48.666553 30629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7e27818bb3f449b38bee8c8f78b5fcb9: Generated new TSK 0
I20260929 06:37:48.666755 30629 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:48.676220 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 30534
2026-09-29T06:37:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1313 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:48 dist-test-slave-601b krb5kdc[30633](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:48 dist-test-slave-601b krb5kdc[30633](info): set up 2 sockets
Sep 29 06:37:48 dist-test-slave-601b krb5kdc[30633](info): commencing operation
krb5kdc: starting...
W20260929 06:37:49.704213 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.010s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:49 dist-test-slave-601b krb5kdc[30633](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:37:49.826732 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41297
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:49.909509 30646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:49.909825 30646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:49.909871 30646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:49.911130 30646 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:49.911207 30646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:49.911231 30646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:49.911254 30646 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:49.911283 30646 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:49.912879 30646 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41297
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:49.913193 30646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:49.913432 30646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:49.918443 30651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:49.918443 30652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:49.918612 30646 server_base.cc:1034] running on GCE node
W20260929 06:37:49.918514 30654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:49.919005 30646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:49.919387 30646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:49.920567 30646 hybrid_clock.cc:648] HybridClock initialized: now 1790663869920552 us; error 32 us; skew 500 ppm
Sep 29 06:37:49 dist-test-slave-601b krb5kdc[30633](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663869, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:49.927794 30646 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:37:49.928432 30646 webserver.cc:460] Webserver started at http://127.0.0.1:44425/ using document root <none> and password file <none>
I20260929 06:37:49.928712 30646 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:49.928789 30646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:49.928941 30646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:49.930087 30646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "ad5996cbd4c140a7aef75f4e240ade8b"
format_stamp: "Formatted at 2026-09-29 06:37:49 on dist-test-slave-601b"
server_key: "5a21c568ae9e14b7754eb8367f87fa21"
server_key_iv: "eb28f1add6db6ea2eac0e22fd3654fdf"
server_key_version: "encryptionkey@0"
I20260929 06:37:49.930464 30646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "ad5996cbd4c140a7aef75f4e240ade8b"
format_stamp: "Formatted at 2026-09-29 06:37:49 on dist-test-slave-601b"
server_key: "5a21c568ae9e14b7754eb8367f87fa21"
server_key_iv: "eb28f1add6db6ea2eac0e22fd3654fdf"
server_key_version: "encryptionkey@0"
I20260929 06:37:49.932094 30646 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:37:49.932928 30661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:49.933220 30646 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:49.933338 30646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "ad5996cbd4c140a7aef75f4e240ade8b"
format_stamp: "Formatted at 2026-09-29 06:37:49 on dist-test-slave-601b"
server_key: "5a21c568ae9e14b7754eb8367f87fa21"
server_key_iv: "eb28f1add6db6ea2eac0e22fd3654fdf"
server_key_version: "encryptionkey@0"
I20260929 06:37:49.933418 30646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:49.945094 30646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:49.947642 30646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:49.947817 30646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:49.952031 30646 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41297
I20260929 06:37:49.952073 30713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41297 every 8 connection(s)
I20260929 06:37:49.952488 30646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:49.953619 30714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:49.956059 30714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b: Bootstrap starting.
I20260929 06:37:49.956631 30714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:49.956866 30714 log.cc:824] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:49.957556 30714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b: No bootstrap required, opened a new log
I20260929 06:37:49.959129 30714 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5996cbd4c140a7aef75f4e240ade8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41297 } }
I20260929 06:37:49.959278 30714 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:49.959301 30714 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5996cbd4c140a7aef75f4e240ade8b, State: Initialized, Role: FOLLOWER
I20260929 06:37:49.959455 30714 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5996cbd4c140a7aef75f4e240ade8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41297 } }
I20260929 06:37:49.959542 30714 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:49.959565 30714 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:49.959599 30714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:49.960243 30714 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5996cbd4c140a7aef75f4e240ade8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41297 } }
I20260929 06:37:49.960336 30714 leader_election.cc:302] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad5996cbd4c140a7aef75f4e240ade8b; no voters:
I20260929 06:37:49.960489 30714 leader_election.cc:288] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:49.960552 30717 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:49.960791 30717 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [term 1 LEADER]: Becoming Leader. State: Replica: ad5996cbd4c140a7aef75f4e240ade8b, State: Running, Role: LEADER
I20260929 06:37:49.960804 30714 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:49.960891 30717 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5996cbd4c140a7aef75f4e240ade8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41297 } }
I20260929 06:37:49.961279 30719 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad5996cbd4c140a7aef75f4e240ade8b. Latest consensus state: current_term: 1 leader_uuid: "ad5996cbd4c140a7aef75f4e240ade8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5996cbd4c140a7aef75f4e240ade8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41297 } } }
I20260929 06:37:49.961431 30719 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:49.961418 30718 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad5996cbd4c140a7aef75f4e240ade8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5996cbd4c140a7aef75f4e240ade8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41297 } } }
I20260929 06:37:49.961513 30718 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:49.962004 30727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:49.962298 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 30646
I20260929 06:37:49.962421 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:49.962584 30727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:49.962621 9461 external_mini_cluster.cc:1428] Setting key 700bef4284b43e9d5f64921c55add00b
I20260929 06:37:49.964304 30727 catalog_manager.cc:1347] Generated new cluster ID: 75aee46bcea841b0aabb890501fe5202
I20260929 06:37:49.964351 30727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:37:49 dist-test-slave-601b krb5kdc[30633](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260929 06:37:49.973214 30736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:49.963274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.65:58757 (local address 127.0.0.1:41297)
0929 06:37:49.963615 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:49.963624 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:49.963656 (+ 32us) server_negotiation.cc:407] Connection header received
0929 06:37:49.963811 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:49.963824 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:49.963872 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:49.964070 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:49.964721 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:49.965666 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:49.966452 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:49.966920 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:49.967055 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:49.969654 (+ 2599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:49.969658 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:49.969659 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:49.969671 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:49.971466 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:49.971887 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:49.971892 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:49.971892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:49.972062 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:49.972304 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:49.972305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:49.972306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:49.972584 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:49.972774 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:49.972876 (+ 102us) server_negotiation.cc:299] Negotiation successful
0929 06:37:49.972986 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":66,"threads_started":1}
I20260929 06:37:49.974298 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:49.978698 30727 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:49.979408 30727 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:49.985854 30727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad5996cbd4c140a7aef75f4e240ade8b: Generated new TSK 0
I20260929 06:37:49.986166 30727 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:49.986860 30736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:49.975824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.65:45723 (local address 127.0.0.1:41297)
0929 06:37:49.975869 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:49.975871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:49.980182 (+ 4311us) server_negotiation.cc:407] Connection header received
0929 06:37:49.980269 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:49.980270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:49.980282 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:49.980351 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:49.980947 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:49.981490 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:49.982269 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:49.982481 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:49.982570 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:49.983912 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:49.983913 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:49.983914 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:49.983922 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:49.985540 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:49.985997 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:49.985998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:49.985998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:49.986067 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:49.986333 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:49.986334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:49.986334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:49.986452 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:49.986568 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:49.986695 (+ 127us) server_negotiation.cc:299] Negotiation successful
0929 06:37:49.986760 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260929 06:37:49.988884 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 30646
W20260929 06:37:49.994139 30631 connection.cc:535] client connection to 127.0.0.1:41297 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41297): Connection reset by peer (error 104)
2026-09-29T06:37:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1313 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:50 dist-test-slave-601b krb5kdc[30745](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:50 dist-test-slave-601b krb5kdc[30745](info): set up 2 sockets
Sep 29 06:37:50 dist-test-slave-601b krb5kdc[30745](info): commencing operation
krb5kdc: starting...
W20260929 06:37:51.024353 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:51 dist-test-slave-601b krb5kdc[30745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:37:51.138903 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45835
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45835
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:51.219743 30758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:51.219934 30758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:51.220018 30758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:51.221140 30758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:51.221186 30758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:51.221201 30758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:51.221215 30758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:51.221251 30758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:51.222795 30758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45835
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:51.223037 30758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:51.223301 30758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:51.227990 30764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:51.228051 30766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:51.227996 30763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:51.228168 30758 server_base.cc:1034] running on GCE node
I20260929 06:37:51.228483 30758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:51.228724 30758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:51.229944 30758 hybrid_clock.cc:648] HybridClock initialized: now 1790663871229932 us; error 45 us; skew 500 ppm
Sep 29 06:37:51 dist-test-slave-601b krb5kdc[30745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663871, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:51.232237 30758 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:37:51.232606 30758 webserver.cc:460] Webserver started at http://127.0.0.1:36913/ using document root <none> and password file <none>
I20260929 06:37:51.232786 30758 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:51.232825 30758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:51.232910 30758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:51.233857 30758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "596815514fbc408d9c596c5bc12e26d0"
format_stamp: "Formatted at 2026-09-29 06:37:51 on dist-test-slave-601b"
server_key: "2d039aeb49bfeeb5e7738429c10e61ca"
server_key_iv: "4e293b10e2dc37c5d21bf1e5b4bfc89f"
server_key_version: "encryptionkey@0"
I20260929 06:37:51.234146 30758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "596815514fbc408d9c596c5bc12e26d0"
format_stamp: "Formatted at 2026-09-29 06:37:51 on dist-test-slave-601b"
server_key: "2d039aeb49bfeeb5e7738429c10e61ca"
server_key_iv: "4e293b10e2dc37c5d21bf1e5b4bfc89f"
server_key_version: "encryptionkey@0"
I20260929 06:37:51.235420 30758 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260929 06:37:51.236141 30773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:51.236338 30758 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260929 06:37:51.236436 30758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "596815514fbc408d9c596c5bc12e26d0"
format_stamp: "Formatted at 2026-09-29 06:37:51 on dist-test-slave-601b"
server_key: "2d039aeb49bfeeb5e7738429c10e61ca"
server_key_iv: "4e293b10e2dc37c5d21bf1e5b4bfc89f"
server_key_version: "encryptionkey@0"
I20260929 06:37:51.236511 30758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:51.254689 30758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:51.256490 30758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:51.256652 30758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:51.260504 30758 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45835
I20260929 06:37:51.260571 30825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45835 every 8 connection(s)
I20260929 06:37:51.260921 30758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:51.261787 30826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:51.263837 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 30758
I20260929 06:37:51.263923 30826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0: Bootstrap starting.
I20260929 06:37:51.263999 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:51.264232 9461 external_mini_cluster.cc:1428] Setting key 0729b0c16395c49fcd59ae03eb244be0
I20260929 06:37:51.264712 30826 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:51.265090 30826 log.cc:824] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:51.265798 30826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0: No bootstrap required, opened a new log
I20260929 06:37:51.268085 30826 raft_consensus.cc:348] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596815514fbc408d9c596c5bc12e26d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45835 } }
I20260929 06:37:51.268213 30826 raft_consensus.cc:374] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:51.268235 30826 raft_consensus.cc:729] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 596815514fbc408d9c596c5bc12e26d0, State: Initialized, Role: FOLLOWER
I20260929 06:37:51.268369 30826 consensus_queue.cc:260] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596815514fbc408d9c596c5bc12e26d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45835 } }
I20260929 06:37:51.268450 30826 raft_consensus.cc:388] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:51.268478 30826 raft_consensus.cc:482] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:51.268522 30826 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:51.269184 30826 raft_consensus.cc:504] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596815514fbc408d9c596c5bc12e26d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45835 } }
I20260929 06:37:51.269292 30826 leader_election.cc:302] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 596815514fbc408d9c596c5bc12e26d0; no voters:
I20260929 06:37:51.269486 30826 leader_election.cc:288] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:51.269517 30831 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:51.269731 30826 sys_catalog.cc:564] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:51.269954 30831 raft_consensus.cc:686] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [term 1 LEADER]: Becoming Leader. State: Replica: 596815514fbc408d9c596c5bc12e26d0, State: Running, Role: LEADER
I20260929 06:37:51.270099 30831 consensus_queue.cc:237] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596815514fbc408d9c596c5bc12e26d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45835 } }
I20260929 06:37:51.270715 30833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 596815514fbc408d9c596c5bc12e26d0. Latest consensus state: current_term: 1 leader_uuid: "596815514fbc408d9c596c5bc12e26d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596815514fbc408d9c596c5bc12e26d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45835 } } }
I20260929 06:37:51.270798 30833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:51.270934 30832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "596815514fbc408d9c596c5bc12e26d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596815514fbc408d9c596c5bc12e26d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45835 } } }
I20260929 06:37:51.271019 30832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:51.271495 30829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:51.264780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.65:52843 (local address 127.0.0.1:45835)
0929 06:37:51.264993 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:51.265002 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:51.265039 (+ 37us) server_negotiation.cc:407] Connection header received
0929 06:37:51.265588 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:51.265596 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:51.265658 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:51.265814 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:51.266049 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:51.267400 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:51.268393 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:51.269020 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:51.269146 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:51.269876 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:51.269880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:51.269880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:51.270093 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:51.270126 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:51.270139 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:51.270215 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:51.271280 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0929 06:37:51.271307 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":89,"threads_started":1}
I20260929 06:37:51.272442 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260929 06:37:51.272697 30846 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:37:51.272760 30846 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:37:51.272831 30843 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:51.272989 30843 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:51.274353 30843 catalog_manager.cc:1347] Generated new cluster ID: 45611927dc534bfe8c4d97803a759da0
I20260929 06:37:51.274399 30843 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:51.276952 30829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:51.274062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.65:60423 (local address 127.0.0.1:45835)
0929 06:37:51.274113 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:51.274115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:51.274234 (+ 119us) server_negotiation.cc:407] Connection header received
0929 06:37:51.274304 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:51.274305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:51.274316 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:51.274367 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:51.274518 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:51.275004 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:51.275699 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:51.275999 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:51.276067 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:51.276722 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:51.276723 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:51.276724 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:51.276728 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:51.276741 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:51.276744 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:51.276798 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:51.276856 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 06:37:51.276863 (+ 7us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:37:51.298887 30843 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:51.299458 30843 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:51.310128 30843 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 596815514fbc408d9c596c5bc12e26d0: Generated new TSK 0
I20260929 06:37:51.310341 30843 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:51.316926 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 30758
W20260929 06:37:51.321352 30743 connection.cc:535] client connection to 127.0.0.1:45835 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45835): Connection reset by peer (error 104)
2026-09-29T06:37:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1326 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:51 dist-test-slave-601b krb5kdc[30857](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:51 dist-test-slave-601b krb5kdc[30857](info): set up 2 sockets
Sep 29 06:37:51 dist-test-slave-601b krb5kdc[30857](info): commencing operation
krb5kdc: starting...
W20260929 06:37:52.352128 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:52 dist-test-slave-601b krb5kdc[30857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260929 06:37:52.466678 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36191
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36191
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:52.545759 30870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:52.545949 30870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:52.545971 30870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:52.547138 30870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:52.547183 30870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:52.547199 30870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:52.547210 30870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:52.547223 30870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:52.548740 30870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36191
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:52.548969 30870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:52.549206 30870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:52.554061 30875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:52.554127 30870 server_base.cc:1034] running on GCE node
W20260929 06:37:52.554082 30876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:52.554051 30878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:52.554562 30870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:52.554862 30870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:52.556021 30870 hybrid_clock.cc:648] HybridClock initialized: now 1790663872555998 us; error 41 us; skew 500 ppm
Sep 29 06:37:52 dist-test-slave-601b krb5kdc[30857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663872, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:52.558580 30870 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260929 06:37:52.559051 30870 webserver.cc:460] Webserver started at http://127.0.0.1:36613/ using document root <none> and password file <none>
I20260929 06:37:52.559291 30870 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:52.559357 30870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:52.559504 30870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:52.560598 30870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "2d296128b6504611b34aa6c8436dd418"
format_stamp: "Formatted at 2026-09-29 06:37:52 on dist-test-slave-601b"
server_key: "0dbaf1910dfa929fc6469978da380a69"
server_key_iv: "bea8766ea7fcdaaccc73c5844884223e"
server_key_version: "encryptionkey@0"
I20260929 06:37:52.560973 30870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "2d296128b6504611b34aa6c8436dd418"
format_stamp: "Formatted at 2026-09-29 06:37:52 on dist-test-slave-601b"
server_key: "0dbaf1910dfa929fc6469978da380a69"
server_key_iv: "bea8766ea7fcdaaccc73c5844884223e"
server_key_version: "encryptionkey@0"
I20260929 06:37:52.562281 30870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:37:52.562986 30885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:52.563159 30870 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:37:52.563263 30870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "2d296128b6504611b34aa6c8436dd418"
format_stamp: "Formatted at 2026-09-29 06:37:52 on dist-test-slave-601b"
server_key: "0dbaf1910dfa929fc6469978da380a69"
server_key_iv: "bea8766ea7fcdaaccc73c5844884223e"
server_key_version: "encryptionkey@0"
I20260929 06:37:52.563335 30870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:52.566663 30870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:52.568993 30870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:52.569152 30870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:52.573091 30870 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36191
I20260929 06:37:52.573120 30937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36191 every 8 connection(s)
I20260929 06:37:52.573437 30870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:52.574383 30938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:52.576632 30938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418: Bootstrap starting.
I20260929 06:37:52.577136 30938 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:52.577358 30938 log.cc:824] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:52.578022 30938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418: No bootstrap required, opened a new log
I20260929 06:37:52.579504 30938 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d296128b6504611b34aa6c8436dd418" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36191 } }
I20260929 06:37:52.579634 30938 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:52.579656 30938 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d296128b6504611b34aa6c8436dd418, State: Initialized, Role: FOLLOWER
I20260929 06:37:52.579772 30938 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d296128b6504611b34aa6c8436dd418" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36191 } }
I20260929 06:37:52.579823 30938 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:52.579843 30938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:52.579869 30938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:52.580403 30938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d296128b6504611b34aa6c8436dd418" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36191 } }
I20260929 06:37:52.580485 30938 leader_election.cc:302] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d296128b6504611b34aa6c8436dd418; no voters:
I20260929 06:37:52.580600 30938 leader_election.cc:288] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:52.580654 30941 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:52.580845 30941 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [term 1 LEADER]: Becoming Leader. State: Replica: 2d296128b6504611b34aa6c8436dd418, State: Running, Role: LEADER
I20260929 06:37:52.580866 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 30870
I20260929 06:37:52.580886 30938 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:52.580981 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:52.580966 30941 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d296128b6504611b34aa6c8436dd418" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36191 } }
I20260929 06:37:52.581209 9461 external_mini_cluster.cc:1428] Setting key 2790dbbb27d0b8b5ec6cb352f0122043
I20260929 06:37:52.581343 30941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d296128b6504611b34aa6c8436dd418. Latest consensus state: current_term: 1 leader_uuid: "2d296128b6504611b34aa6c8436dd418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d296128b6504611b34aa6c8436dd418" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36191 } } }
I20260929 06:37:52.581384 30942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d296128b6504611b34aa6c8436dd418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d296128b6504611b34aa6c8436dd418" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36191 } } }
I20260929 06:37:52.581413 30941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:52.581431 30942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:52.581588 30945 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:52.582245 30945 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:52.583928 30945 catalog_manager.cc:1347] Generated new cluster ID: 865a0cc13ae547758a4f98dc6f7dcdba
I20260929 06:37:52.583984 30954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:52.581976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.65:42291 (local address 127.0.0.1:36191)
0929 06:37:52.582128 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:52.582138 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:52.582299 (+ 161us) server_negotiation.cc:407] Connection header received
0929 06:37:52.582427 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:52.582434 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:52.582466 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:52.582961 (+ 495us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:52.583445 (+ 484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:52.583448 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:52.583448 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:52.583452 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:52.583498 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:52.583515 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:52.583626 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:52.583708 (+ 82us) server_negotiation.cc:299] Negotiation successful
0929 06:37:52.583755 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":75,"threads_started":1}
I20260929 06:37:52.583997 30945 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:52.585026 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:52.587577 30954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:52.586517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.65:44929 (local address 127.0.0.1:36191)
0929 06:37:52.586599 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:52.586601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:52.586653 (+ 52us) server_negotiation.cc:407] Connection header received
0929 06:37:52.586737 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:52.586737 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:52.586742 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:52.586790 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:52.587371 (+ 581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:52.587371 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:52.587372 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:52.587375 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:52.587385 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:52.587389 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:52.587449 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:52.587507 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 06:37:52.587518 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260929 06:37:52.593932 30945 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:52.594099 30945 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:52.598424 30945 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d296128b6504611b34aa6c8436dd418: Generated new TSK 0
I20260929 06:37:52.598618 30945 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:52.603888 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 30870
2026-09-29T06:37:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1286 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:52 dist-test-slave-601b krb5kdc[30969](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:52 dist-test-slave-601b krb5kdc[30969](info): set up 2 sockets
Sep 29 06:37:52 dist-test-slave-601b krb5kdc[30969](info): commencing operation
krb5kdc: starting...
W20260929 06:37:53.628054 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.006s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:53 dist-test-slave-601b krb5kdc[30969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:37:53.745082 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:38131
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:44033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:38131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:53.824604 30982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:53.824810 30982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:53.824833 30982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:53.825987 30982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:53.826031 30982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:53.826045 30982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:53.826058 30982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:53.826071 30982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:53.827581 30982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:44033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:38131
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:38131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:53.827826 30982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:53.828083 30982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:53.832917 30987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:53.833009 30982 server_base.cc:1034] running on GCE node
W20260929 06:37:53.832950 30990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:53.833104 30988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:53.833354 30982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:53.833657 30982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:53.834813 30982 hybrid_clock.cc:648] HybridClock initialized: now 1790663873834790 us; error 36 us; skew 500 ppm
Sep 29 06:37:53 dist-test-slave-601b krb5kdc[30969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663873, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:53.837270 30982 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:37:53.837734 30982 webserver.cc:460] Webserver started at http://127.9.61.126:39615/ using document root <none> and password file <none>
I20260929 06:37:53.837960 30982 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:53.838022 30982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:53.838161 30982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:53.839202 30982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "1f58f297333f47dd87b16149b7c43ae8"
format_stamp: "Formatted at 2026-09-29 06:37:53 on dist-test-slave-601b"
server_key: "7b74be1d0c255c2020b98b875f719bde"
server_key_iv: "02ea3b64096334f76dcaa75f290b6c4a"
server_key_version: "encryptionkey@0"
I20260929 06:37:53.839550 30982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "1f58f297333f47dd87b16149b7c43ae8"
format_stamp: "Formatted at 2026-09-29 06:37:53 on dist-test-slave-601b"
server_key: "7b74be1d0c255c2020b98b875f719bde"
server_key_iv: "02ea3b64096334f76dcaa75f290b6c4a"
server_key_version: "encryptionkey@0"
I20260929 06:37:53.840911 30982 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:37:53.841598 30997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:53.841763 30982 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:53.841858 30982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "1f58f297333f47dd87b16149b7c43ae8"
format_stamp: "Formatted at 2026-09-29 06:37:53 on dist-test-slave-601b"
server_key: "7b74be1d0c255c2020b98b875f719bde"
server_key_iv: "02ea3b64096334f76dcaa75f290b6c4a"
server_key_version: "encryptionkey@0"
I20260929 06:37:53.841928 30982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:53.852355 30982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:53.854561 30982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:53.854724 30982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:53.858705 30982 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:38131
I20260929 06:37:53.858737 31049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:38131 every 8 connection(s)
I20260929 06:37:53.859087 30982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:53.859509 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 30982
I20260929 06:37:53.859683 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:53.859905 9461 external_mini_cluster.cc:1428] Setting key 515e9437260f760a0a93a1ad755bb1f4
I20260929 06:37:53.860167 31050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:53.863397 31050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8: Bootstrap starting.
I20260929 06:37:53.864104 31050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:53.864403 31050 log.cc:824] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:53.865044 31050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8: No bootstrap required, opened a new log
Sep 29 06:37:53 dist-test-slave-601b krb5kdc[30969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:53.866813 31050 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f58f297333f47dd87b16149b7c43ae8" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38131 } }
I20260929 06:37:53.866942 31050 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:53.866966 31050 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f58f297333f47dd87b16149b7c43ae8, State: Initialized, Role: FOLLOWER
I20260929 06:37:53.867121 31050 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f58f297333f47dd87b16149b7c43ae8" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38131 } }
I20260929 06:37:53.867202 31050 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:53.867250 31050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:53.867316 31050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:53.867976 31050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f58f297333f47dd87b16149b7c43ae8" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38131 } }
I20260929 06:37:53.868098 31050 leader_election.cc:302] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f58f297333f47dd87b16149b7c43ae8; no voters:
I20260929 06:37:53.868278 31050 leader_election.cc:288] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:53.868305 31055 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:53.868426 31055 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [term 1 LEADER]: Becoming Leader. State: Replica: 1f58f297333f47dd87b16149b7c43ae8, State: Running, Role: LEADER
I20260929 06:37:53.868589 31050 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:53.868552 31055 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f58f297333f47dd87b16149b7c43ae8" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38131 } }
I20260929 06:37:53.870435 31057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f58f297333f47dd87b16149b7c43ae8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f58f297333f47dd87b16149b7c43ae8" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38131 } } }
I20260929 06:37:53.870517 31057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:53.870736 31056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f58f297333f47dd87b16149b7c43ae8. Latest consensus state: current_term: 1 leader_uuid: "1f58f297333f47dd87b16149b7c43ae8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f58f297333f47dd87b16149b7c43ae8" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 38131 } } }
I20260929 06:37:53.870800 31053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:53.860405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43547 (local address 127.9.61.126:38131)
0929 06:37:53.860582 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:53.860591 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:53.860623 (+ 32us) server_negotiation.cc:407] Connection header received
0929 06:37:53.861270 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:53.861278 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:53.861325 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:53.861436 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:53.862252 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:53.863098 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:53.864204 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:53.864672 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:53.864829 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:53.867107 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:53.867111 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:53.867111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:53.867123 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:53.869031 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:53.869516 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:53.869519 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:53.869519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:53.869618 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:53.869901 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:53.869902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:53.869902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:53.870179 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:53.870338 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:53.870463 (+ 125us) server_negotiation.cc:299] Negotiation successful
0929 06:37:53.870557 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
I20260929 06:37:53.870805 31056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8 [sys.catalog]: This master's current role is: LEADER
W20260929 06:37:53.871750 31071 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260929 06:37:53.871819 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260929 06:37:53.873121 31071 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:37:53.873206 31069 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:53.873390 31069 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:53.874804 31069 catalog_manager.cc:1347] Generated new cluster ID: 9425cec3ce7b49359c59f8533a704d80
I20260929 06:37:53.874848 31069 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:53.881031 31053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:53.873926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46145 (local address 127.9.61.126:38131)
0929 06:37:53.873969 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:53.873971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:53.873978 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:37:53.873993 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:53.873994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:53.874001 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:53.874059 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:53.874633 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:53.875346 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:53.876360 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:53.876655 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:53.876714 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:53.878133 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:53.878135 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:53.878135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:53.878141 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:53.879769 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:53.880221 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:53.880222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:53.880222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:53.880275 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:53.880524 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:53.880524 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:53.880525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:53.880633 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:53.880725 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:53.880881 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 06:37:53.880948 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:37:53.894616 31069 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:53.895164 31069 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:53.904640 31069 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f58f297333f47dd87b16149b7c43ae8: Generated new TSK 0
I20260929 06:37:53.904836 31069 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:53.909296 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 30982
W20260929 06:37:53.913571 30967 connection.cc:535] client connection to 127.9.61.126:38131 recv error: Network error: failed to read from TLS socket (remote: 127.9.61.126:38131): Connection reset by peer (error 104)
2026-09-29T06:37:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1305 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:53 dist-test-slave-601b krb5kdc[31081](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:53 dist-test-slave-601b krb5kdc[31081](info): set up 2 sockets
Sep 29 06:37:53 dist-test-slave-601b krb5kdc[31081](info): commencing operation
krb5kdc: starting...
W20260929 06:37:54.944068 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:55 dist-test-slave-601b krb5kdc[31081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:37:55.058818 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:43819
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:43819
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:55.138895 31094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:55.139087 31094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:55.139111 31094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:55.140231 31094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:55.140270 31094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:55.140285 31094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:55.140297 31094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:55.140309 31094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:55.141701 31094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:43819
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:43819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:55.141886 31094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:55.142047 31094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:55.146656 31099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:55.146682 31094 server_base.cc:1034] running on GCE node
W20260929 06:37:55.146663 31102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:55.146648 31100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:55.147198 31094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:55.147512 31094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:55.148667 31094 hybrid_clock.cc:648] HybridClock initialized: now 1790663875148661 us; error 34 us; skew 500 ppm
Sep 29 06:37:55 dist-test-slave-601b krb5kdc[31081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:55.154086 31094 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:37:55.154520 31094 webserver.cc:460] Webserver started at http://127.9.61.126:39203/ using document root <none> and password file <none>
I20260929 06:37:55.154703 31094 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:55.154742 31094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:55.154825 31094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:55.155835 31094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "9229a7f2bdf2465e91ea4131690a4799"
format_stamp: "Formatted at 2026-09-29 06:37:55 on dist-test-slave-601b"
server_key: "533a4ea7c6d89f8cbfebf4f6433487ef"
server_key_iv: "24f70d05c1daafd4c05466823f9cda49"
server_key_version: "encryptionkey@0"
I20260929 06:37:55.156188 31094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "9229a7f2bdf2465e91ea4131690a4799"
format_stamp: "Formatted at 2026-09-29 06:37:55 on dist-test-slave-601b"
server_key: "533a4ea7c6d89f8cbfebf4f6433487ef"
server_key_iv: "24f70d05c1daafd4c05466823f9cda49"
server_key_version: "encryptionkey@0"
I20260929 06:37:55.157460 31094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:55.158134 31109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:55.158288 31094 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:37:55.158373 31094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "9229a7f2bdf2465e91ea4131690a4799"
format_stamp: "Formatted at 2026-09-29 06:37:55 on dist-test-slave-601b"
server_key: "533a4ea7c6d89f8cbfebf4f6433487ef"
server_key_iv: "24f70d05c1daafd4c05466823f9cda49"
server_key_version: "encryptionkey@0"
I20260929 06:37:55.158429 31094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:55.177145 31094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:55.178995 31094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:55.179104 31094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:55.182880 31094 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:43819
I20260929 06:37:55.182951 31161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:43819 every 8 connection(s)
I20260929 06:37:55.183277 31094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:55.184186 31162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:55.186338 31162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799: Bootstrap starting.
I20260929 06:37:55.186879 31162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:55.187146 31162 log.cc:824] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:55.187865 31162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799: No bootstrap required, opened a new log
I20260929 06:37:55.189531 31162 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9229a7f2bdf2465e91ea4131690a4799" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43819 } }
I20260929 06:37:55.189669 31162 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:55.189692 31162 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9229a7f2bdf2465e91ea4131690a4799, State: Initialized, Role: FOLLOWER
I20260929 06:37:55.189821 31162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9229a7f2bdf2465e91ea4131690a4799" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43819 } }
I20260929 06:37:55.189899 31162 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:55.189921 31162 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:55.189956 31162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:55.190759 31162 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9229a7f2bdf2465e91ea4131690a4799" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43819 } }
I20260929 06:37:55.190841 31162 leader_election.cc:302] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9229a7f2bdf2465e91ea4131690a4799; no voters:
I20260929 06:37:55.190974 31162 leader_election.cc:288] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:55.191039 31165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:55.191231 31165 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [term 1 LEADER]: Becoming Leader. State: Replica: 9229a7f2bdf2465e91ea4131690a4799, State: Running, Role: LEADER
I20260929 06:37:55.191277 31162 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:55.191394 31165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9229a7f2bdf2465e91ea4131690a4799" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43819 } }
I20260929 06:37:55.191740 31166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9229a7f2bdf2465e91ea4131690a4799" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9229a7f2bdf2465e91ea4131690a4799" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43819 } } }
I20260929 06:37:55.191745 31167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9229a7f2bdf2465e91ea4131690a4799. Latest consensus state: current_term: 1 leader_uuid: "9229a7f2bdf2465e91ea4131690a4799" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9229a7f2bdf2465e91ea4131690a4799" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43819 } } }
I20260929 06:37:55.191931 31167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:55.191865 31166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:55.192152 31174 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:55.192696 31174 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:55.193065 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 31094
I20260929 06:37:55.193181 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:55.193372 9461 external_mini_cluster.cc:1428] Setting key 7910648decf2b5a695c1dedc691eadc5
I20260929 06:37:55.194350 31174 catalog_manager.cc:1347] Generated new cluster ID: d5839fb4225f4e31ab0ebc6792626750
I20260929 06:37:55.194418 31174 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:55.199846 31185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:55.193997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36751 (local address 127.9.61.126:43819)
0929 06:37:55.194411 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:55.194421 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:55.194452 (+ 31us) server_negotiation.cc:407] Connection header received
0929 06:37:55.194563 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:55.194569 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:55.194623 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:55.194764 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:55.194992 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:55.196458 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:55.197510 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:55.198128 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:55.198254 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:55.198981 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:55.198985 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:55.198986 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:55.199198 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:55.199235 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:55.199250 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:55.199332 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:55.199431 (+ 99us) server_negotiation.cc:299] Negotiation successful
0929 06:37:55.199460 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":74,"threads_started":1}
I20260929 06:37:55.200282 31174 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:55.200901 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:55.200929 31174 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:55.206578 31174 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9229a7f2bdf2465e91ea4131690a4799: Generated new TSK 0
I20260929 06:37:55.206743 31174 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:55.206900 31185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:55.202281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58671 (local address 127.9.61.126:43819)
0929 06:37:55.202316 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:55.202318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:55.204093 (+ 1775us) server_negotiation.cc:407] Connection header received
0929 06:37:55.204164 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:55.204165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:55.204177 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:55.204231 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:55.204369 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:55.204874 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:55.205610 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:55.205835 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:55.205916 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:55.206629 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:55.206630 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:55.206631 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:55.206634 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:55.206649 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:55.206653 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:55.206702 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:55.206795 (+ 93us) server_negotiation.cc:299] Negotiation successful
0929 06:37:55.206806 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:37:55.208668 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 31094
W20260929 06:37:55.212594 31079 connection.cc:535] client connection to 127.9.61.126:43819 recv error: Network error: failed to read from TLS socket (remote: 127.9.61.126:43819): Connection reset by peer (error 104)
2026-09-29T06:37:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1298 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:55 dist-test-slave-601b krb5kdc[31193](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:55 dist-test-slave-601b krb5kdc[31193](info): set up 2 sockets
Sep 29 06:37:55 dist-test-slave-601b krb5kdc[31193](info): commencing operation
krb5kdc: starting...
W20260929 06:37:56.232087 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.006s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:56 dist-test-slave-601b krb5kdc[31193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:37:56.344985 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:45837
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:36943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:45837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:56.424964 31206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:56.425171 31206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:56.425194 31206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:56.426259 31206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:56.426294 31206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:56.426308 31206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:56.426321 31206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:56.426332 31206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:56.427691 31206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:36943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:45837
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:45837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:56.427873 31206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:56.428061 31206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:56.432653 31212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:56.432721 31211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:56.432667 31214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:56.432876 31206 server_base.cc:1034] running on GCE node
I20260929 06:37:56.433100 31206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:56.433368 31206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:56.434516 31206 hybrid_clock.cc:648] HybridClock initialized: now 1790663876434497 us; error 36 us; skew 500 ppm
Sep 29 06:37:56 dist-test-slave-601b krb5kdc[31193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663876, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:56.436882 31206 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:37:56.437245 31206 webserver.cc:460] Webserver started at http://127.9.61.126:42973/ using document root <none> and password file <none>
I20260929 06:37:56.437440 31206 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:56.437481 31206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:56.437565 31206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:56.438521 31206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "cb7f079e23c84d94b59c44ed912a6b2b"
format_stamp: "Formatted at 2026-09-29 06:37:56 on dist-test-slave-601b"
server_key: "2f5d691d7ab10bdfdcae7c0859464dbf"
server_key_iv: "c462c194edfccdcd27f0f5d9eb366476"
server_key_version: "encryptionkey@0"
I20260929 06:37:56.438802 31206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "cb7f079e23c84d94b59c44ed912a6b2b"
format_stamp: "Formatted at 2026-09-29 06:37:56 on dist-test-slave-601b"
server_key: "2f5d691d7ab10bdfdcae7c0859464dbf"
server_key_iv: "c462c194edfccdcd27f0f5d9eb366476"
server_key_version: "encryptionkey@0"
I20260929 06:37:56.440168 31206 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:37:56.441265 31221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:56.441473 31206 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:56.441565 31206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "cb7f079e23c84d94b59c44ed912a6b2b"
format_stamp: "Formatted at 2026-09-29 06:37:56 on dist-test-slave-601b"
server_key: "2f5d691d7ab10bdfdcae7c0859464dbf"
server_key_iv: "c462c194edfccdcd27f0f5d9eb366476"
server_key_version: "encryptionkey@0"
I20260929 06:37:56.441637 31206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:56.444957 31206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:56.446952 31206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:56.447109 31206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:56.451192 31206 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:45837
I20260929 06:37:56.451275 31273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:45837 every 8 connection(s)
I20260929 06:37:56.451565 31206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:56.452607 31274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:56.454828 31274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b: Bootstrap starting.
I20260929 06:37:56.455399 31274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:56.455667 31274 log.cc:824] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:56.456378 31274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b: No bootstrap required, opened a new log
I20260929 06:37:56.457881 31274 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb7f079e23c84d94b59c44ed912a6b2b" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45837 } }
I20260929 06:37:56.458012 31274 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:56.458034 31274 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb7f079e23c84d94b59c44ed912a6b2b, State: Initialized, Role: FOLLOWER
I20260929 06:37:56.458134 31274 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb7f079e23c84d94b59c44ed912a6b2b" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45837 } }
I20260929 06:37:56.458209 31274 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:56.458243 31274 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:56.458309 31274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:56.459115 31274 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb7f079e23c84d94b59c44ed912a6b2b" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45837 } }
I20260929 06:37:56.459240 31274 leader_election.cc:302] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb7f079e23c84d94b59c44ed912a6b2b; no voters:
I20260929 06:37:56.459308 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 31206
I20260929 06:37:56.459424 31274 leader_election.cc:288] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:56.459450 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:56.459474 31277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:56.459656 9461 external_mini_cluster.cc:1428] Setting key 05774337509b21f5f6845622736c6795
I20260929 06:37:56.459664 31274 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:56.459666 31277 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [term 1 LEADER]: Becoming Leader. State: Replica: cb7f079e23c84d94b59c44ed912a6b2b, State: Running, Role: LEADER
I20260929 06:37:56.459878 31277 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb7f079e23c84d94b59c44ed912a6b2b" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45837 } }
I20260929 06:37:56.460327 31278 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb7f079e23c84d94b59c44ed912a6b2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb7f079e23c84d94b59c44ed912a6b2b" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45837 } } }
I20260929 06:37:56.460309 31279 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb7f079e23c84d94b59c44ed912a6b2b. Latest consensus state: current_term: 1 leader_uuid: "cb7f079e23c84d94b59c44ed912a6b2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb7f079e23c84d94b59c44ed912a6b2b" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 45837 } } }
I20260929 06:37:56.460496 31278 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:56.460511 31279 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:56.460918 31288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:56.461414 31288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:56.462954 31282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:56.460125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60633 (local address 127.9.61.126:45837)
0929 06:37:56.461452 (+ 1327us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:56.461460 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:56.461489 (+ 29us) server_negotiation.cc:407] Connection header received
0929 06:37:56.461603 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:56.461609 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:56.461649 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:56.461779 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:56.462451 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:56.462455 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:56.462456 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:56.462460 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:56.462500 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:56.462515 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:56.462594 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:56.462755 (+ 161us) server_negotiation.cc:299] Negotiation successful
0929 06:37:56.462807 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1276,"thread_start_us":76,"threads_started":1}
I20260929 06:37:56.463402 31288 catalog_manager.cc:1347] Generated new cluster ID: c0db8c1ab39748c8859438dce36bdbdf
I20260929 06:37:56.463450 31288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:56.463989 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:56.473727 31288 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:56.473898 31288 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:56.480767 31288 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb7f079e23c84d94b59c44ed912a6b2b: Generated new TSK 0
I20260929 06:37:56.480955 31288 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:56.481460 31282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:56.468339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56125 (local address 127.9.61.126:45837)
0929 06:37:56.468373 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:56.468375 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:56.473445 (+ 5070us) server_negotiation.cc:407] Connection header received
0929 06:37:56.473518 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:56.473519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:56.473524 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:56.473591 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:56.481235 (+ 7644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:56.481236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:56.481237 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:56.481241 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:56.481257 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:56.481262 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:56.481328 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:56.481373 (+ 45us) server_negotiation.cc:299] Negotiation successful
0929 06:37:56.481386 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:37:56.482841 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 31206
2026-09-29T06:37:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1275 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:56 dist-test-slave-601b krb5kdc[31305](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:56 dist-test-slave-601b krb5kdc[31305](info): set up 2 sockets
Sep 29 06:37:56 dist-test-slave-601b krb5kdc[31305](info): commencing operation
krb5kdc: starting...
W20260929 06:37:57.511997 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:57 dist-test-slave-601b krb5kdc[31305](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:37:57.626591 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:37045
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:37045
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:57.709180 31318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:57.709422 31318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:57.709447 31318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:57.710570 31318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:57.710610 31318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:57.710624 31318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:57.710636 31318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:57.710649 31318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:57.712170 31318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:37045
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:37045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:57.712387 31318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:57.712564 31318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:57.717371 31323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:57.717375 31326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:57.717635 31318 server_base.cc:1034] running on GCE node
W20260929 06:37:57.717707 31324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:57.718078 31318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:57.718456 31318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:57.719656 31318 hybrid_clock.cc:648] HybridClock initialized: now 1790663877719639 us; error 38 us; skew 500 ppm
Sep 29 06:37:57 dist-test-slave-601b krb5kdc[31305](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663877, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:57.722340 31318 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:37:57.722812 31318 webserver.cc:460] Webserver started at http://127.9.61.126:46299/ using document root <none> and password file <none>
I20260929 06:37:57.723058 31318 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:57.723131 31318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:57.723277 31318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:57.724463 31318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "b0f58d874dbe473a83f19c5bf63e60f4"
format_stamp: "Formatted at 2026-09-29 06:37:57 on dist-test-slave-601b"
server_key: "2b999ed96e64712081f5f1f5c485a06c"
server_key_iv: "95043bdba8f4a77ff4cf673401e760c6"
server_key_version: "encryptionkey@0"
I20260929 06:37:57.724841 31318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "b0f58d874dbe473a83f19c5bf63e60f4"
format_stamp: "Formatted at 2026-09-29 06:37:57 on dist-test-slave-601b"
server_key: "2b999ed96e64712081f5f1f5c485a06c"
server_key_iv: "95043bdba8f4a77ff4cf673401e760c6"
server_key_version: "encryptionkey@0"
I20260929 06:37:57.726212 31318 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:37:57.726934 31333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:57.727104 31318 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:37:57.727209 31318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "b0f58d874dbe473a83f19c5bf63e60f4"
format_stamp: "Formatted at 2026-09-29 06:37:57 on dist-test-slave-601b"
server_key: "2b999ed96e64712081f5f1f5c485a06c"
server_key_iv: "95043bdba8f4a77ff4cf673401e760c6"
server_key_version: "encryptionkey@0"
I20260929 06:37:57.727288 31318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:57.738255 31318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:57.740653 31318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:57.740772 31318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:57.745543 31318 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:37045
I20260929 06:37:57.745571 31385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:37045 every 8 connection(s)
I20260929 06:37:57.745944 31318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:57.746816 31386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:57.749239 31386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4: Bootstrap starting.
I20260929 06:37:57.749846 31386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:57.750130 31386 log.cc:824] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:57.750864 31386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4: No bootstrap required, opened a new log
I20260929 06:37:57.751147 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 31318
I20260929 06:37:57.751262 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:57.751442 9461 external_mini_cluster.cc:1428] Setting key 01b3b4f3444e5b0aabdfdbdfeeaf8a46
I20260929 06:37:57.753852 31386 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f58d874dbe473a83f19c5bf63e60f4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37045 } }
I20260929 06:37:57.754031 31386 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:57.754066 31386 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f58d874dbe473a83f19c5bf63e60f4, State: Initialized, Role: FOLLOWER
I20260929 06:37:57.754212 31386 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f58d874dbe473a83f19c5bf63e60f4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37045 } }
I20260929 06:37:57.754304 31386 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:57.754345 31386 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:57.754392 31386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:57.755115 31386 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f58d874dbe473a83f19c5bf63e60f4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37045 } }
I20260929 06:37:57.755229 31386 leader_election.cc:302] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0f58d874dbe473a83f19c5bf63e60f4; no voters:
I20260929 06:37:57.755426 31386 leader_election.cc:288] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:57.755450 31391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:57.755579 31391 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [term 1 LEADER]: Becoming Leader. State: Replica: b0f58d874dbe473a83f19c5bf63e60f4, State: Running, Role: LEADER
I20260929 06:37:57.755719 31391 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f58d874dbe473a83f19c5bf63e60f4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37045 } }
I20260929 06:37:57.755729 31386 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:57.756232 31393 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0f58d874dbe473a83f19c5bf63e60f4. Latest consensus state: current_term: 1 leader_uuid: "b0f58d874dbe473a83f19c5bf63e60f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f58d874dbe473a83f19c5bf63e60f4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37045 } } }
I20260929 06:37:57.756315 31393 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:57.756526 31392 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0f58d874dbe473a83f19c5bf63e60f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0f58d874dbe473a83f19c5bf63e60f4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37045 } } }
I20260929 06:37:57.756649 31392 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4 [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:57.756852 31397 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:57.757424 31397 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:57.759023 31397 catalog_manager.cc:1347] Generated new cluster ID: 666fe8b4c24147a293a67b3888d3f2d3
I20260929 06:37:57.759089 31397 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 29 06:37:57 dist-test-slave-601b krb5kdc[31305](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:37:57.765170 31390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:57.751989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47969 (local address 127.9.61.126:37045)
0929 06:37:57.752184 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:57.752194 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:57.752229 (+ 35us) server_negotiation.cc:407] Connection header received
0929 06:37:57.752922 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:57.752932 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:57.752999 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:57.753168 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:57.753751 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:57.755152 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:57.756380 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:57.757144 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:57.757250 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:57.760525 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:57.760530 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:57.760530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:57.760543 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:57.762835 (+ 2292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:57.763253 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:57.763257 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:57.763257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:57.763381 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:57.763617 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:57.763618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:57.763618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:57.764034 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:57.764214 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:57.764517 (+ 303us) server_negotiation.cc:299] Negotiation successful
0929 06:37:57.764755 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
I20260929 06:37:57.766134 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:57.775362 31397 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:57.775812 31390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:57.767868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40161 (local address 127.9.61.126:37045)
0929 06:37:57.767908 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:57.767910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:57.768079 (+ 169us) server_negotiation.cc:407] Connection header received
0929 06:37:57.768148 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:57.768149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:57.768160 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:57.768213 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:57.768923 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:57.769693 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:57.770813 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:57.771114 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:57.771175 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:57.772805 (+ 1630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:57.772807 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:57.772807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:37:57.772814 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:57.774509 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:57.774953 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:57.774954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:57.774954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:57.775024 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:37:57.775241 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:37:57.775242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:37:57.775242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:37:57.775381 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:57.775486 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:57.775640 (+ 154us) server_negotiation.cc:299] Negotiation successful
0929 06:37:57.775724 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:37:57.776296 31397 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:57.782091 31397 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0f58d874dbe473a83f19c5bf63e60f4: Generated new TSK 0
I20260929 06:37:57.782305 31397 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:57.787824 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 31318
2026-09-29T06:37:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1304 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:57 dist-test-slave-601b krb5kdc[31417](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:57 dist-test-slave-601b krb5kdc[31417](info): set up 2 sockets
Sep 29 06:37:57 dist-test-slave-601b krb5kdc[31417](info): commencing operation
krb5kdc: starting...
W20260929 06:37:58.820026 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:37:58 dist-test-slave-601b krb5kdc[31417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:37:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:37:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:37:58.937031 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:37193
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:41699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:37193
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:37:59.018625 31430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:37:59.018837 31430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:37:59.018860 31430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:37:59.020069 31430 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:37:59.020129 31430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:37:59.020143 31430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:37:59.020156 31430 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:37:59.020169 31430 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:37:59.021672 31430 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:41699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:37193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:37193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:37:59.021929 31430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:37:59.022166 31430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:37:59.026927 31438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:59.026921 31435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:37:59.026906 31436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:37:59.027202 31430 server_base.cc:1034] running on GCE node
I20260929 06:37:59.027447 31430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:37:59.027693 31430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:37:59.028831 31430 hybrid_clock.cc:648] HybridClock initialized: now 1790663879028819 us; error 28 us; skew 500 ppm
Sep 29 06:37:59 dist-test-slave-601b krb5kdc[31417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663879, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:37:59.031335 31430 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:37:59.031778 31430 webserver.cc:460] Webserver started at http://127.9.61.126:40443/ using document root <none> and password file <none>
I20260929 06:37:59.032074 31430 fs_manager.cc:359] Metadata directory not provided
I20260929 06:37:59.032140 31430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:37:59.032486 31430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:37:59.033566 31430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "edb86a43c48a4bd6bed949f21c2f3fde"
format_stamp: "Formatted at 2026-09-29 06:37:59 on dist-test-slave-601b"
server_key: "00af9baba038f19cc2059acf34815b32"
server_key_iv: "107e188ba6309704edd9841b21119b5d"
server_key_version: "encryptionkey@0"
I20260929 06:37:59.033982 31430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "edb86a43c48a4bd6bed949f21c2f3fde"
format_stamp: "Formatted at 2026-09-29 06:37:59 on dist-test-slave-601b"
server_key: "00af9baba038f19cc2059acf34815b32"
server_key_iv: "107e188ba6309704edd9841b21119b5d"
server_key_version: "encryptionkey@0"
I20260929 06:37:59.035339 31430 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:37:59.036170 31445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:37:59.036338 31430 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:37:59.036434 31430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "edb86a43c48a4bd6bed949f21c2f3fde"
format_stamp: "Formatted at 2026-09-29 06:37:59 on dist-test-slave-601b"
server_key: "00af9baba038f19cc2059acf34815b32"
server_key_iv: "107e188ba6309704edd9841b21119b5d"
server_key_version: "encryptionkey@0"
I20260929 06:37:59.036516 31430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:37:59.051074 31430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:37:59.053086 31430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:37:59.053258 31430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:37:59.057158 31430 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:37193
I20260929 06:37:59.057212 31497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:37193 every 8 connection(s)
I20260929 06:37:59.057570 31430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:37:59.058445 31498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:37:59.060814 31498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde: Bootstrap starting.
I20260929 06:37:59.061426 31498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde: Neither blocks nor log segments found. Creating new log.
I20260929 06:37:59.061705 31498 log.cc:824] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde: Log is configured to *not* fsync() on all Append() calls
I20260929 06:37:59.061892 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 31430
I20260929 06:37:59.062011 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:37:59.062191 9461 external_mini_cluster.cc:1428] Setting key 2a85b1818a12dbb6e82fb0e51eab7118
I20260929 06:37:59.062531 31498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde: No bootstrap required, opened a new log
I20260929 06:37:59.065385 31498 raft_consensus.cc:348] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb86a43c48a4bd6bed949f21c2f3fde" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37193 } }
I20260929 06:37:59.065560 31498 raft_consensus.cc:374] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:37:59.065591 31498 raft_consensus.cc:729] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb86a43c48a4bd6bed949f21c2f3fde, State: Initialized, Role: FOLLOWER
I20260929 06:37:59.065712 31498 consensus_queue.cc:260] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb86a43c48a4bd6bed949f21c2f3fde" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37193 } }
I20260929 06:37:59.065817 31498 raft_consensus.cc:388] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:37:59.065891 31498 raft_consensus.cc:482] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:37:59.065960 31498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:37:59.066608 31498 raft_consensus.cc:504] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb86a43c48a4bd6bed949f21c2f3fde" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37193 } }
I20260929 06:37:59.066732 31498 leader_election.cc:302] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: edb86a43c48a4bd6bed949f21c2f3fde; no voters:
I20260929 06:37:59.066900 31498 leader_election.cc:288] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:37:59.066933 31503 raft_consensus.cc:2781] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:37:59.067137 31503 raft_consensus.cc:686] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [term 1 LEADER]: Becoming Leader. State: Replica: edb86a43c48a4bd6bed949f21c2f3fde, State: Running, Role: LEADER
I20260929 06:37:59.067160 31498 sys_catalog.cc:564] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:37:59.067902 31503 consensus_queue.cc:237] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb86a43c48a4bd6bed949f21c2f3fde" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37193 } }
I20260929 06:37:59.068172 31502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:59.062652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46103 (local address 127.9.61.126:37193)
0929 06:37:59.062826 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:59.062834 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:59.062861 (+ 27us) server_negotiation.cc:407] Connection header received
0929 06:37:59.063312 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:59.063319 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:59.063368 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:59.063483 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:59.063716 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:59.064691 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:59.065824 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:59.066323 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:59.066402 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:59.067339 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:59.067343 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:59.067343 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:59.067579 (+ 236us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:59.067631 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:59.067649 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:59.067725 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:59.067843 (+ 118us) server_negotiation.cc:299] Negotiation successful
0929 06:37:59.067926 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260929 06:37:59.069006 31505 sys_catalog.cc:455] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [sys.catalog]: SysCatalogTable state changed. Reason: New leader edb86a43c48a4bd6bed949f21c2f3fde. Latest consensus state: current_term: 1 leader_uuid: "edb86a43c48a4bd6bed949f21c2f3fde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb86a43c48a4bd6bed949f21c2f3fde" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37193 } } }
I20260929 06:37:59.069056 31504 sys_catalog.cc:455] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "edb86a43c48a4bd6bed949f21c2f3fde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb86a43c48a4bd6bed949f21c2f3fde" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 37193 } } }
I20260929 06:37:59.069238 31505 sys_catalog.cc:458] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [sys.catalog]: This master's current role is: LEADER
I20260929 06:37:59.069299 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:37:59.069248 31504 sys_catalog.cc:458] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde [sys.catalog]: This master's current role is: LEADER
W20260929 06:37:59.070998 31517 catalog_manager.cc:1558] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:37:59.071110 31517 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:37:59.071275 31518 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:37:59.071483 31518 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:37:59.073088 31518 catalog_manager.cc:1347] Generated new cluster ID: 307c223edc624e86bcc3597b92b3da1d
I20260929 06:37:59.073137 31518 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:37:59.073909 31502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:37:59.070677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52383 (local address 127.9.61.126:37193)
0929 06:37:59.070713 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:37:59.070715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:37:59.070815 (+ 100us) server_negotiation.cc:407] Connection header received
0929 06:37:59.070863 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:37:59.070864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:37:59.070873 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:37:59.070943 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:37:59.071075 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:59.071796 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:59.072644 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:37:59.072919 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:37:59.073000 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:37:59.073684 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:37:59.073685 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:37:59.073685 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:37:59.073689 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:37:59.073704 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:37:59.073708 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:37:59.073760 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0929 06:37:59.073817 (+ 57us) server_negotiation.cc:299] Negotiation successful
0929 06:37:59.073837 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:37:59.088016 31518 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:37:59.088773 31518 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:37:59.093104 31518 catalog_manager.cc:5868] T 00000000000000000000000000000000 P edb86a43c48a4bd6bed949f21c2f3fde: Generated new TSK 0
I20260929 06:37:59.093295 31518 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:37:59.099042 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 31430
2026-09-29T06:37:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1310 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:37:59 dist-test-slave-601b krb5kdc[31529](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:37:59 dist-test-slave-601b krb5kdc[31529](info): set up 2 sockets
Sep 29 06:37:59 dist-test-slave-601b krb5kdc[31529](info): commencing operation
krb5kdc: starting...
W20260929 06:38:00.140054 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:38:00 dist-test-slave-601b krb5kdc[31529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:38:00.258450 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:32849
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:32849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:00.341663 31542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:00.341892 31542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:00.341917 31542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:00.343207 31542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:00.343286 31542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:00.343302 31542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:00.343315 31542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:00.343328 31542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:00.345005 31542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:32849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:32849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:00.345289 31542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:00.345535 31542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:00.350600 31548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:00.350600 31550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:00.350602 31547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:00.350654 31542 server_base.cc:1034] running on GCE node
I20260929 06:38:00.351096 31542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:00.351438 31542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:00.352630 31542 hybrid_clock.cc:648] HybridClock initialized: now 1790663880352608 us; error 38 us; skew 500 ppm
Sep 29 06:38:00 dist-test-slave-601b krb5kdc[31529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663880, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:00.358848 31542 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:38:00.359299 31542 webserver.cc:460] Webserver started at http://127.9.61.126:34757/ using document root <none> and password file <none>
I20260929 06:38:00.359531 31542 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:00.359587 31542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:00.359737 31542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:00.360918 31542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "5f4613cc992246cb942cd2f786b48e0c"
format_stamp: "Formatted at 2026-09-29 06:38:00 on dist-test-slave-601b"
server_key: "6b99b1d2d344c0862daca1fe355b9f19"
server_key_iv: "dc086b6477745c3290cfc5bfb87ce97b"
server_key_version: "encryptionkey@0"
I20260929 06:38:00.361313 31542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "5f4613cc992246cb942cd2f786b48e0c"
format_stamp: "Formatted at 2026-09-29 06:38:00 on dist-test-slave-601b"
server_key: "6b99b1d2d344c0862daca1fe355b9f19"
server_key_iv: "dc086b6477745c3290cfc5bfb87ce97b"
server_key_version: "encryptionkey@0"
I20260929 06:38:00.362742 31542 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260929 06:38:00.363574 31557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:00.363768 31542 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:00.363864 31542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "5f4613cc992246cb942cd2f786b48e0c"
format_stamp: "Formatted at 2026-09-29 06:38:00 on dist-test-slave-601b"
server_key: "6b99b1d2d344c0862daca1fe355b9f19"
server_key_iv: "dc086b6477745c3290cfc5bfb87ce97b"
server_key_version: "encryptionkey@0"
I20260929 06:38:00.363972 31542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:00.367380 31542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:00.369797 31542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:00.369966 31542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:00.373960 31542 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:32849
I20260929 06:38:00.374017 31609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:32849 every 8 connection(s)
I20260929 06:38:00.374352 31542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:00.375394 31610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:00.377780 31610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c: Bootstrap starting.
I20260929 06:38:00.378371 31610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:00.378692 31610 log.cc:824] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:00.379482 31610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c: No bootstrap required, opened a new log
I20260929 06:38:00.381229 31610 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f4613cc992246cb942cd2f786b48e0c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32849 } }
I20260929 06:38:00.381384 31610 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 06:38:00.381408 31610 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f4613cc992246cb942cd2f786b48e0c, State: Initialized, Role: FOLLOWER
I20260929 06:38:00.381577 31610 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f4613cc992246cb942cd2f786b48e0c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32849 } }
I20260929 06:38:00.381667 31610 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 06:38:00.381691 31610 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 06:38:00.381750 31610 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:00.382638 31610 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f4613cc992246cb942cd2f786b48e0c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32849 } }
I20260929 06:38:00.382732 31610 leader_election.cc:302] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f4613cc992246cb942cd2f786b48e0c; no voters:
I20260929 06:38:00.382929 31610 leader_election.cc:288] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 06:38:00.382977 31613 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:00.383200 31610 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:00.383210 31613 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [term 1 LEADER]: Becoming Leader. State: Replica: 5f4613cc992246cb942cd2f786b48e0c, State: Running, Role: LEADER
I20260929 06:38:00.383328 31613 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f4613cc992246cb942cd2f786b48e0c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32849 } }
I20260929 06:38:00.383700 31614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f4613cc992246cb942cd2f786b48e0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f4613cc992246cb942cd2f786b48e0c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32849 } } }
I20260929 06:38:00.383733 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 31542
I20260929 06:38:00.383859 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:38:00.383922 31614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:00.384157 9461 external_mini_cluster.cc:1428] Setting key 41b39bf8f96eeaac07868bd41f71b533
I20260929 06:38:00.383853 31615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f4613cc992246cb942cd2f786b48e0c. Latest consensus state: current_term: 1 leader_uuid: "5f4613cc992246cb942cd2f786b48e0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f4613cc992246cb942cd2f786b48e0c" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 32849 } } }
I20260929 06:38:00.384349 31615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:00.384481 31622 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:00.385110 31622 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:00.386687 31622 catalog_manager.cc:1347] Generated new cluster ID: c604d8ec423040499232cc67843681ff
I20260929 06:38:00.386739 31622 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:00.386763 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:00.384839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39303 (local address 127.9.61.126:32849)
0929 06:38:00.385025 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:00.385036 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:00.385313 (+ 277us) server_negotiation.cc:407] Connection header received
0929 06:38:00.385414 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:00.385419 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:00.385444 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:00.385573 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:00.386270 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:00.386273 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:00.386273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:00.386277 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:00.386317 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:00.386334 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:00.386395 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:00.386495 (+ 100us) server_negotiation.cc:299] Negotiation successful
0929 06:38:00.386535 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":91,"threads_started":1}
I20260929 06:38:00.387598 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:38:00.390146 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:00.389073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32847 (local address 127.9.61.126:32849)
0929 06:38:00.389109 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:00.389111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:00.389136 (+ 25us) server_negotiation.cc:407] Connection header received
0929 06:38:00.389207 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:00.389208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:00.389214 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:00.389258 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:00.389856 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:00.389858 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:00.389858 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0929 06:38:00.389862 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:00.389875 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0929 06:38:00.389880 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:00.389936 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:00.389994 (+ 58us) server_negotiation.cc:299] Negotiation successful
0929 06:38:00.390008 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260929 06:38:00.422433 31622 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:00.422648 31622 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:00.426086 31622 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f4613cc992246cb942cd2f786b48e0c: Generated new TSK 0
I20260929 06:38:00.426303 31622 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 06:38:00.435611 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 31542
2026-09-29T06:38:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1336 ms)
[----------] 18 tests from AuthTokenIssuingTest (23668 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:00 dist-test-slave-601b krb5kdc[31641](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:00 dist-test-slave-601b krb5kdc[31641](info): set up 2 sockets
Sep 29 06:38:00 dist-test-slave-601b krb5kdc[31641](info): commencing operation
krb5kdc: starting...
W20260929 06:38:01.504088 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:38:01 dist-test-slave-601b krb5kdc[31641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:38:01.622545 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41809
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:41809,127.9.61.125:41365,127.9.61.124:40573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:01.704425 31654 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 06:38:01.704659 31654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:01.704689 31654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:01.704728 31654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:01.705971 31654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:01.706032 31654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:01.706054 31654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:01.706076 31654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:01.706103 31654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:01.707563 31654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:41809,127.9.61.125:41365,127.9.61.124:40573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:41809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:01.707842 31654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:01.708109 31654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:01.712984 31659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:01.712990 31660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:01.713065 31654 server_base.cc:1034] running on GCE node
W20260929 06:38:01.713022 31662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:01.713485 31654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:01.713820 31654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:01.714959 31654 hybrid_clock.cc:648] HybridClock initialized: now 1790663881714942 us; error 36 us; skew 500 ppm
Sep 29 06:38:01 dist-test-slave-601b krb5kdc[31641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663881, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:01.717392 31654 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:38:01.717943 31654 webserver.cc:460] Webserver started at http://127.9.61.126:42715/ using document root <none> and password file <none>
I20260929 06:38:01.718159 31654 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:01.718209 31654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:01.718333 31654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:01.719400 31654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "ba35993edb934b63acd9e8d9631cea72"
format_stamp: "Formatted at 2026-09-29 06:38:01 on dist-test-slave-601b"
server_key: "f99233de98b7b2a9c576b1a6cccbd406"
server_key_iv: "73435ff9cf25406178f4e0175fc23afa"
server_key_version: "encryptionkey@0"
I20260929 06:38:01.719754 31654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "ba35993edb934b63acd9e8d9631cea72"
format_stamp: "Formatted at 2026-09-29 06:38:01 on dist-test-slave-601b"
server_key: "f99233de98b7b2a9c576b1a6cccbd406"
server_key_iv: "73435ff9cf25406178f4e0175fc23afa"
server_key_version: "encryptionkey@0"
I20260929 06:38:01.721117 31654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:01.721987 31669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:01.722153 31654 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:01.722244 31654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "ba35993edb934b63acd9e8d9631cea72"
format_stamp: "Formatted at 2026-09-29 06:38:01 on dist-test-slave-601b"
server_key: "f99233de98b7b2a9c576b1a6cccbd406"
server_key_iv: "73435ff9cf25406178f4e0175fc23afa"
server_key_version: "encryptionkey@0"
I20260929 06:38:01.722312 31654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:01.736056 31654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:01.738448 31654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:01.738566 31654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:01.742340 31654 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:41809
I20260929 06:38:01.742376 31721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:41809 every 8 connection(s)
I20260929 06:38:01.742723 31654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:01.743713 31722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:01.745322 31722 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:01.747215 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 31654
I20260929 06:38:01.747352 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:38:01.747557 9461 external_mini_cluster.cc:1428] Setting key d3b819f4b29d9883ef5c9b8ce6e1fe2c
Sep 29 06:38:01 dist-test-slave-601b krb5kdc[31641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663881, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.61.125@KRBTEST.COM; defaulting to no policy
I20260929 06:38:01.756474 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.746032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60526 (local address 127.9.61.126:41809)
0929 06:38:01.746199 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:01.746203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:01.746276 (+ 73us) server_negotiation.cc:407] Connection header received
0929 06:38:01.746761 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:01.746763 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:01.746779 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:01.746858 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:01.747527 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.748489 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.749504 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.749977 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.750062 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:01.752768 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:01.752778 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:01.752778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:01.752787 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:01.754737 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:01.755097 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:01.755100 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:01.755101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:01.755216 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:01.755433 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:01.755434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:01.755434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:01.755741 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:01.755831 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:01.756062 (+ 231us) server_negotiation.cc:299] Negotiation successful
0929 06:38:01.756198 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
I20260929 06:38:01.756479 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.745988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41809 (local address 127.0.0.1:60526)
0929 06:38:01.746144 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.746190 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:01.746637 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:01.746902 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:01.746904 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:01.747175 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:01.747399 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:01.747405 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.748594 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.748595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:01.749416 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:01.749418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.750083 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.750085 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:01.750165 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:01.750727 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:01.750738 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:01.752668 (+ 1930us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:01.754815 (+ 2147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:01.754821 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:01.754823 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:01.755013 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:01.755291 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:01.755292 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:01.755292 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:01.755371 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:01.755815 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:01.755820 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:01.755876 (+ 56us) client_negotiation.cc:769] Sending connection context
0929 06:38:01.756012 (+ 136us) client_negotiation.cc:240] Negotiation successful
0929 06:38:01.756278 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":102,"thread_start_us":65,"threads_started":1}
I20260929 06:38:01.757282 31722 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:01.757632 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.757519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:41365 (local address 127.0.0.1:46982)
0929 06:38:01.757566 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.757611 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 06:38:01.757797 31671 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.61.125:41365: connect: Connection refused (error 111)
I20260929 06:38:01.758239 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.758146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:41365 (local address 127.0.0.1:46984)
0929 06:38:01.758191 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.758219 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 06:38:01.758414 31722 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.125:41365: Network error: Client connection negotiation failed: client connection to 127.9.61.125:41365: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.125.keytab.
Entry for principal kudu/127.9.61.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.125.keytab.
I20260929 06:38:01.773099 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.125:41365
--webserver_interface=127.9.61.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.125.keytab
--principal=kudu/127.9.61.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:41809,127.9.61.125:41365,127.9.61.124:40573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:38:01.807663 31722 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } attempt: 1
I20260929 06:38:01.808261 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.808105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:41365 (local address 127.0.0.1:46994)
0929 06:38:01.808181 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.808228 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260929 06:38:01.808691 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.808600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:41365 (local address 127.0.0.1:47002)
0929 06:38:01.808644 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.808670 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260929 06:38:01.808800 31722 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.125:41365: Network error: Client connection negotiation failed: client connection to 127.9.61.125:41365: connect: Connection refused (error 111)
W20260929 06:38:01.854233 31729 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 06:38:01.854440 31729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:01.854457 31729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:01.854477 31729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:01.855535 31729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:01.855569 31729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:01.855583 31729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:01.855597 31729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:01.855608 31729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:01.857098 31729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:41809,127.9.61.125:41365,127.9.61.124:40573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.125.keytab
--principal=kudu/127.9.61.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.125:41365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.61.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:01.857319 31729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:01.857574 31729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:01.862412 31737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:01.862445 31734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:01.862408 31735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:01.862602 31729 server_base.cc:1034] running on GCE node
I20260929 06:38:01.862918 31729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:01.863157 31729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:01.864310 31729 hybrid_clock.cc:648] HybridClock initialized: now 1790663881864296 us; error 44 us; skew 500 ppm
Sep 29 06:38:01 dist-test-slave-601b krb5kdc[31641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663881, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:01.869781 31729 init.cc:377] Logged in from keytab as kudu/127.9.61.125@KRBTEST.COM (short username kudu)
I20260929 06:38:01.870215 31729 webserver.cc:460] Webserver started at http://127.9.61.125:39625/ using document root <none> and password file <none>
I20260929 06:38:01.870450 31729 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:01.870514 31729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:01.870657 31729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:01.871716 31729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/data/instance:
uuid: "183cd91fcc73441bab4cf7ba8e2a742d"
format_stamp: "Formatted at 2026-09-29 06:38:01 on dist-test-slave-601b"
server_key: "d4bddf28d76ffcb56ad319d6b9735910"
server_key_iv: "ba1828c102867edcf6b1bf32e1254bc8"
server_key_version: "encryptionkey@0"
I20260929 06:38:01.872107 31729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/wal/instance:
uuid: "183cd91fcc73441bab4cf7ba8e2a742d"
format_stamp: "Formatted at 2026-09-29 06:38:01 on dist-test-slave-601b"
server_key: "d4bddf28d76ffcb56ad319d6b9735910"
server_key_iv: "ba1828c102867edcf6b1bf32e1254bc8"
server_key_version: "encryptionkey@0"
I20260929 06:38:01.873414 31729 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:01.874111 31744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:01.874269 31729 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:01.874380 31729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/wal
uuid: "183cd91fcc73441bab4cf7ba8e2a742d"
format_stamp: "Formatted at 2026-09-29 06:38:01 on dist-test-slave-601b"
server_key: "d4bddf28d76ffcb56ad319d6b9735910"
server_key_iv: "ba1828c102867edcf6b1bf32e1254bc8"
server_key_version: "encryptionkey@0"
I20260929 06:38:01.874452 31729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:01.876943 31722 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } attempt: 2
I20260929 06:38:01.877358 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.877223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:41365 (local address 127.0.0.1:47008)
0929 06:38:01.877281 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.877319 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 06:38:01.877715 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.877616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:41365 (local address 127.0.0.1:47018)
0929 06:38:01.877660 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.877689 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 06:38:01.877821 31722 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.125:41365: Network error: Client connection negotiation failed: client connection to 127.9.61.125:41365: connect: Connection refused (error 111)
I20260929 06:38:01.909727 31729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:01.911751 31729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:01.911859 31729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:01.915696 31729 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.125:41365
I20260929 06:38:01.915728 31796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.125:41365 every 8 connection(s)
I20260929 06:38:01.916149 31729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
I20260929 06:38:01.917104 31797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:01.918500 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 31729
I20260929 06:38:01.918587 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-1/wal/instance
I20260929 06:38:01.918761 9461 external_mini_cluster.cc:1428] Setting key fe97f502fd45d69f40f933fc9359733a
I20260929 06:38:01.918756 31797 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:38:01 dist-test-slave-601b krb5kdc[31641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663881, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.125@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.61.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.124@KRBTEST.COM" created.
I20260929 06:38:01.928884 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.919512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60536 (local address 127.9.61.126:41809)
0929 06:38:01.919576 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:01.919578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:01.919784 (+ 206us) server_negotiation.cc:407] Connection header received
0929 06:38:01.920459 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:01.920460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:01.920469 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:01.920519 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:01.921395 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.922202 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.923250 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.923625 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.923730 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:01.926074 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:01.926076 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:01.926076 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:01.926084 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:01.927439 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:01.927850 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:01.927852 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:01.927852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:01.927914 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:01.928214 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:01.928215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:01.928215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:01.928339 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:01.928421 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:01.928702 (+ 281us) server_negotiation.cc:299] Negotiation successful
0929 06:38:01.928791 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260929 06:38:01.929083 31799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.919484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41809 (local address 127.0.0.1:60536)
0929 06:38:01.919653 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.919696 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:01.920354 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:01.920592 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:01.920597 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:01.920989 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:01.921288 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:01.921293 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.922301 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.922302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:01.923160 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:01.923163 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.923758 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.923759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:01.923864 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:01.924461 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:01.924469 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:01.925960 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:01.927523 (+ 1563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:01.927531 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:01.927534 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:01.927773 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:01.928032 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:01.928033 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:01.928033 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:01.928144 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:01.928413 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:01.928420 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:01.928563 (+ 143us) client_negotiation.cc:769] Sending connection context
0929 06:38:01.928667 (+ 104us) client_negotiation.cc:240] Negotiation successful
0929 06:38:01.928825 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260929 06:38:01.930706 31797 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:38:01 dist-test-slave-601b krb5kdc[31641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663881, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.125@KRBTEST.COM for kudu/127.9.61.125@KRBTEST.COM
I20260929 06:38:01.938596 31799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.930999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:41365 (local address 127.0.0.1:47030)
0929 06:38:01.931207 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.931218 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:01.931272 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:01.931422 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:01.931423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:01.931589 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:01.931654 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:01.931656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.932632 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.932634 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:01.933544 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:01.933547 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.934005 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.934006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:01.934083 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:01.934466 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:01.934471 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:01.935751 (+ 1280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:01.937563 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:01.937564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:01.937565 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:01.937726 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:01.937939 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:01.937940 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:01.937940 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:01.937993 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:01.938272 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:01.938272 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:01.938308 (+ 36us) client_negotiation.cc:769] Sending connection context
0929 06:38:01.938380 (+ 72us) client_negotiation.cc:240] Negotiation successful
0929 06:38:01.938479 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193}
I20260929 06:38:01.938659 31802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.931065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47030 (local address 127.9.61.125:41365)
0929 06:38:01.931207 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:01.931211 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:01.931265 (+ 54us) server_negotiation.cc:407] Connection header received
0929 06:38:01.931325 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:01.931327 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:01.931338 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:01.931403 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:01.931739 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.932547 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.933627 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.933933 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.933987 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:01.935847 (+ 1860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:01.935856 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:01.935856 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:01.935862 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:01.937463 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:01.937815 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:01.937818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:01.937819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:01.937876 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:01.938060 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:01.938061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:01.938061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:01.938205 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:01.938294 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:01.938410 (+ 116us) server_negotiation.cc:299] Negotiation successful
0929 06:38:01.938529 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260929 06:38:01.939313 31797 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:01.939688 31799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.939579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47400)
0929 06:38:01.939621 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.939669 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260929 06:38:01.939836 31745 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
I20260929 06:38:01.940336 31799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.940254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47410)
0929 06:38:01.940295 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.940319 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260929 06:38:01.940447 31797 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:40573: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.124.keytab.
Entry for principal kudu/127.9.61.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.124.keytab.
I20260929 06:38:01.944020 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.124:40573
--webserver_interface=127.9.61.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.124.keytab
--principal=kudu/127.9.61.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:35413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:41809,127.9.61.125:41365,127.9.61.124:40573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:38:01.968945 31722 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } attempt: 3
Sep 29 06:38:01 dist-test-slave-601b krb5kdc[31641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663881, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for kudu/127.9.61.125@KRBTEST.COM
I20260929 06:38:01.975920 31802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.969393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47034 (local address 127.9.61.125:41365)
0929 06:38:01.969456 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:01.969458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:01.969471 (+ 13us) server_negotiation.cc:407] Connection header received
0929 06:38:01.969502 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:01.969503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:01.969520 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:01.969587 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:01.969939 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.970439 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.971146 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.971366 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.971452 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:01.973329 (+ 1877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:01.973331 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:01.973331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:01.973339 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:01.974708 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:01.975128 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:01.975129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:01.975130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:01.975188 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:01.975386 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:01.975387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:01.975387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:01.975497 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:01.975570 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:01.975748 (+ 178us) server_negotiation.cc:299] Negotiation successful
0929 06:38:01.975824 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:38:01.975927 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.969316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:41365 (local address 127.0.0.1:47034)
0929 06:38:01.969376 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.969391 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:01.969447 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:01.969594 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:01.969596 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:01.969777 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:01.969841 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:01.969852 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.970525 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.970526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:01.971061 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:01.971062 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:01.971453 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:01.971454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:01.971539 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:01.972066 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:01.972071 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:01.973244 (+ 1173us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:01.974855 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:01.974856 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:01.974857 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:01.975056 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:01.975262 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:01.975263 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:01.975263 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:01.975325 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:01.975562 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:01.975562 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:01.975610 (+ 48us) client_negotiation.cc:769] Sending connection context
0929 06:38:01.975719 (+ 109us) client_negotiation.cc:240] Negotiation successful
0929 06:38:01.975820 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260929 06:38:01.976312 31722 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:01.976660 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.976562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47416)
0929 06:38:01.976610 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.976637 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260929 06:38:01.977070 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.976981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47418)
0929 06:38:01.977032 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.977055 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260929 06:38:01.977223 31722 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:40573: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
I20260929 06:38:01.989655 31797 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } attempt: 1
I20260929 06:38:01.990083 31799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.989963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47432)
0929 06:38:01.990018 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.990054 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260929 06:38:01.990396 31799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:01.990307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47444)
0929 06:38:01.990346 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:01.990370 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260929 06:38:01.990474 31797 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:40573: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
I20260929 06:38:02.008381 31722 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } attempt: 1
I20260929 06:38:02.008821 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.008694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47456)
0929 06:38:02.008752 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:02.008791 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 06:38:02.009151 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.009061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47466)
0929 06:38:02.009103 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:02.009126 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260929 06:38:02.009238 31722 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:40573: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
W20260929 06:38:02.028076 31804 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 06:38:02.028275 31804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:02.028291 31804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:02.028335 31804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:02.029429 31804 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:02.029469 31804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:02.029484 31804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:02.029528 31804 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:02.029549 31804 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:02.031008 31804 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:35413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:41809,127.9.61.125:41365,127.9.61.124:40573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.124.keytab
--principal=kudu/127.9.61.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.124:40573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.61.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:02.031243 31804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:02.031466 31804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:02.038600 31810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:02.038614 31809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:02.039052 31804 server_base.cc:1034] running on GCE node
W20260929 06:38:02.039214 31812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:02.039644 31804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:02.040012 31804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:02.041163 31804 hybrid_clock.cc:648] HybridClock initialized: now 1790663882041153 us; error 27 us; skew 500 ppm
Sep 29 06:38:02 dist-test-slave-601b krb5kdc[31641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663882, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:02.044306 31804 init.cc:377] Logged in from keytab as kudu/127.9.61.124@KRBTEST.COM (short username kudu)
I20260929 06:38:02.044876 31804 webserver.cc:460] Webserver started at http://127.9.61.124:35245/ using document root <none> and password file <none>
I20260929 06:38:02.045295 31804 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:02.045365 31804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:02.045516 31804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:02.047236 31804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/data/instance:
uuid: "79d18ae4d8f44c0f8b46efe353d62dfa"
format_stamp: "Formatted at 2026-09-29 06:38:02 on dist-test-slave-601b"
server_key: "af4fe56b32ec90911948d1be9d76c244"
server_key_iv: "a05896f80b6adf0f7455eb09768b40f5"
server_key_version: "encryptionkey@0"
I20260929 06:38:02.047689 31804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/wal/instance:
uuid: "79d18ae4d8f44c0f8b46efe353d62dfa"
format_stamp: "Formatted at 2026-09-29 06:38:02 on dist-test-slave-601b"
server_key: "af4fe56b32ec90911948d1be9d76c244"
server_key_iv: "a05896f80b6adf0f7455eb09768b40f5"
server_key_version: "encryptionkey@0"
I20260929 06:38:02.049921 31804 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260929 06:38:02.050817 31819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:02.050987 31804 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:02.051082 31804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/wal
uuid: "79d18ae4d8f44c0f8b46efe353d62dfa"
format_stamp: "Formatted at 2026-09-29 06:38:02 on dist-test-slave-601b"
server_key: "af4fe56b32ec90911948d1be9d76c244"
server_key_iv: "a05896f80b6adf0f7455eb09768b40f5"
server_key_version: "encryptionkey@0"
I20260929 06:38:02.051152 31804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:02.058604 31797 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } attempt: 2
I20260929 06:38:02.059069 31799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.058925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47478)
0929 06:38:02.058999 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:02.059039 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260929 06:38:02.059423 31799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.059314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47494)
0929 06:38:02.059363 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:02.059391 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260929 06:38:02.059509 31797 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:40573: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
I20260929 06:38:02.084374 31722 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } attempt: 2
I20260929 06:38:02.084878 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.084750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47504)
0929 06:38:02.084808 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:02.084842 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 06:38:02.085249 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.085148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47516)
0929 06:38:02.085201 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:02.085225 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260929 06:38:02.085350 31722 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:40573: Network error: Client connection negotiation failed: client connection to 127.9.61.124:40573: connect: Connection refused (error 111)
I20260929 06:38:02.090199 31804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:02.092041 31804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:02.092196 31804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:02.095818 31804 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.124:40573
I20260929 06:38:02.095896 31871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.124:40573 every 8 connection(s)
I20260929 06:38:02.096257 31804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
I20260929 06:38:02.097191 31872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:02.098739 31872 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:02.099073 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 31804
I20260929 06:38:02.099229 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790663621200347-9461-0/minicluster-data/master-2/wal/instance
I20260929 06:38:02.099427 9461 external_mini_cluster.cc:1428] Setting key 8565cf4118c6babb3362fb94b75ce86e
Sep 29 06:38:02 dist-test-slave-601b krb5kdc[31641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663882, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.124@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
Sep 29 06:38:02 dist-test-slave-601b krb5kdc[31641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.124@KRBTEST.COM
I20260929 06:38:02.108215 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.099425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60544 (local address 127.9.61.126:41809)
0929 06:38:02.099466 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.099468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.099753 (+ 285us) server_negotiation.cc:407] Connection header received
0929 06:38:02.100331 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.100332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.100345 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.100406 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.100925 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.101409 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.102276 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.102468 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.102549 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.104824 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:02.104825 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:02.104825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:02.104831 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:02.106741 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.107257 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.107258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.107259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.107322 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.107564 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.107565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.107566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.107709 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:02.107781 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:02.108047 (+ 266us) server_negotiation.cc:299] Negotiation successful
0929 06:38:02.108125 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:38:02.108383 31874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.099420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:41809 (local address 127.0.0.1:60544)
0929 06:38:02.099608 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:02.099656 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:02.100228 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:02.100426 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:02.100428 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:02.100683 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:02.100827 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:02.100831 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.101499 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.101500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:02.102172 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:02.102174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.102577 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.102578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:02.102679 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.103213 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:02.103223 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:02.104743 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:02.106814 (+ 2071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:02.106819 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:02.106822 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:02.107169 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:02.107390 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:02.107391 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:02.107391 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:02.107482 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:02.107775 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:02.107780 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:02.107924 (+ 144us) client_negotiation.cc:769] Sending connection context
0929 06:38:02.108025 (+ 101us) client_negotiation.cc:240] Negotiation successful
0929 06:38:02.108168 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":85,"threads_started":1}
I20260929 06:38:02.108386 31876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.099799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47522 (local address 127.9.61.124:40573)
0929 06:38:02.099996 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.100002 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.100062 (+ 60us) server_negotiation.cc:407] Connection header received
0929 06:38:02.100233 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.100239 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.100258 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.100348 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.100940 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.101723 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.102423 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.102732 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.102806 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.105330 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:02.105337 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:02.105338 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:02.105345 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:02.107198 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.107542 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.107545 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.107545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.107596 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.107775 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.107776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.107776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.107934 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:02.108090 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:02.108159 (+ 69us) server_negotiation.cc:299] Negotiation successful
0929 06:38:02.108216 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":97,"threads_started":1}
I20260929 06:38:02.109025 31872 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:38:02 dist-test-slave-601b krb5kdc[31641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663882, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.124@KRBTEST.COM for kudu/127.9.61.125@KRBTEST.COM
Sep 29 06:38:02 dist-test-slave-601b krb5kdc[31641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:38:02.115830 31874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.109248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:41365 (local address 127.0.0.1:47038)
0929 06:38:02.109285 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:02.109294 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:02.109324 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:02.109461 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:02.109462 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:02.109606 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:02.109639 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:02.109640 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.110236 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.110238 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:02.110688 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:02.110689 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.111081 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.111082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:02.111140 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.111531 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:02.111536 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:02.112701 (+ 1165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:02.114853 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:02.114854 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:02.114854 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:02.115018 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:02.115223 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:02.115224 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:02.115224 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:02.115277 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:02.115526 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:02.115527 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:02.115567 (+ 40us) client_negotiation.cc:769] Sending connection context
0929 06:38:02.115646 (+ 79us) client_negotiation.cc:240] Negotiation successful
0929 06:38:02.115734 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260929 06:38:02.115830 31802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.109308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47038 (local address 127.9.61.125:41365)
0929 06:38:02.109360 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.109362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.109371 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:02.109397 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.109398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.109407 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.109460 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.109711 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.110161 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.110781 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.111002 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.111082 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.112784 (+ 1702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:02.112785 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:02.112785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:02.112793 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:02.114758 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.115099 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.115100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.115100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.115154 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.115344 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.115344 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.115345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.115455 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:02.115521 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:02.115676 (+ 155us) server_negotiation.cc:299] Negotiation successful
0929 06:38:02.115744 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:38:02.116233 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.109363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60554 (local address 127.9.61.126:41809)
0929 06:38:02.109394 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.109395 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.109402 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:02.109465 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.109465 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.109474 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.109522 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.110051 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.110470 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.111112 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.111303 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.111394 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.113415 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:02.113416 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:02.113417 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:02.113423 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:02.114903 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.115236 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.115237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.115237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.115289 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.115483 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.115484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.115485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.115584 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:02.115758 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:02.115802 (+ 44us) server_negotiation.cc:299] Negotiation successful
0929 06:38:02.116145 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:38:02.116257 31872 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:38:02 dist-test-slave-601b krb5kdc[31641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663882, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.124@KRBTEST.COM for kudu/127.9.61.124@KRBTEST.COM
Sep 29 06:38:02 dist-test-slave-601b krb5kdc[31641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.125@KRBTEST.COM
I20260929 06:38:02.122596 31876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.116532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47526 (local address 127.9.61.124:40573)
0929 06:38:02.116566 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.116568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.116576 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:02.116630 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.116631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.116651 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.116710 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.116992 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.117461 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.118066 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.118281 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.118365 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.120092 (+ 1727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:02.120093 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:02.120093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:02.120098 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:02.121581 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.121937 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.121938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.121938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.121985 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.122195 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.122196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.122196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.122280 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:02.122325 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:02.122483 (+ 158us) server_negotiation.cc:299] Negotiation successful
0929 06:38:02.122543 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260929 06:38:02.122721 31874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.116501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47526)
0929 06:38:02.116533 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:02.116544 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:02.116581 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:02.116730 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:02.116730 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:02.116884 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:02.116910 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:02.116911 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.117536 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.117537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:02.117993 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:02.117994 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.118362 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.118363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:02.118409 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.118797 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:02.118802 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:02.120015 (+ 1213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:02.121657 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:02.121658 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:02.121659 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:02.121869 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:02.122041 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:02.122042 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:02.122043 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:02.122105 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:02.122338 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:02.122338 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:02.122393 (+ 55us) client_negotiation.cc:769] Sending connection context
0929 06:38:02.122469 (+ 76us) client_negotiation.cc:240] Negotiation successful
0929 06:38:02.122606 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18,"mutex_wait_us":48}
I20260929 06:38:02.123551 31802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.116796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47042 (local address 127.9.61.125:41365)
0929 06:38:02.116836 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.116838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.116845 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:02.116864 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.116865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.116873 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.116925 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.117381 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.117809 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.118443 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.118642 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.118721 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.120807 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:02.120808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:02.120808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:02.120815 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:02.122295 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.122694 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.122695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.122695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.122748 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.123069 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.123070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.123070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.123166 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:02.123342 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:02.123388 (+ 46us) server_negotiation.cc:299] Negotiation successful
0929 06:38:02.123458 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:02.124296 31872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa: Bootstrap starting.
I20260929 06:38:02.124897 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:38:02.125244 31872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:02.125530 31872 log.cc:824] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:02.126243 31872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa: No bootstrap required, opened a new log
I20260929 06:38:02.125864 31696 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ba35993edb934b63acd9e8d9631cea72"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60554
I20260929 06:38:02.127663 31872 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } }
I20260929 06:38:02.127796 31872 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79d18ae4d8f44c0f8b46efe353d62dfa, State: Initialized, Role: FOLLOWER
I20260929 06:38:02.127883 31872 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } }
I20260929 06:38:02.128180 31878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } } }
I20260929 06:38:02.128219 31872 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:02.128262 31878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [sys.catalog]: This master's current role is: FOLLOWER
W20260929 06:38:02.129963 31889 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:38:02.130017 31889 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:38:02.130193 31804 master_runner.cc:186] Error getting master registration for 127.9.61.126:41809: OK, instance_id { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" instance_seqno: 1790663881741242 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 06:38:02.132994 31804 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 06:38:02.150660 31797 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } attempt: 3
Sep 29 06:38:02 dist-test-slave-601b krb5kdc[31641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663881, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.125@KRBTEST.COM for kudu/127.9.61.124@KRBTEST.COM
I20260929 06:38:02.158545 31876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.151121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47538 (local address 127.9.61.124:40573)
0929 06:38:02.151186 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.151189 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.151198 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:02.151224 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.151225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.151235 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.151286 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.151605 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.152128 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.153100 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.153341 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.153404 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.155604 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:02.155606 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:02.155606 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:02.155613 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:02.157295 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.157696 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.157697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.157698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.157754 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.157978 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.157979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.157979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.158144 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:02.158210 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:02.158366 (+ 156us) server_negotiation.cc:299] Negotiation successful
0929 06:38:02.158443 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:38:02.158591 31799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.151038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47538)
0929 06:38:02.151104 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:02.151116 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:02.151166 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:02.151290 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:02.151291 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:02.151486 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:02.151539 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:02.151541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.152221 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.152222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:02.153029 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:02.153032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.153403 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.153404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:02.153461 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.153979 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:02.153999 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:02.155516 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:02.157382 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:02.157383 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:02.157383 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:02.157615 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:02.157818 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:02.157837 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:02.157838 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:02.157915 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:02.158210 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:02.158210 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:02.158261 (+ 51us) client_negotiation.cc:769] Sending connection context
0929 06:38:02.158336 (+ 75us) client_negotiation.cc:240] Negotiation successful
0929 06:38:02.158487 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260929 06:38:02.160264 31797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d: Bootstrap starting.
I20260929 06:38:02.160907 31797 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:02.161196 31797 log.cc:824] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:02.161936 31797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d: No bootstrap required, opened a new log
I20260929 06:38:02.163790 31797 raft_consensus.cc:348] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } }
I20260929 06:38:02.163924 31797 raft_consensus.cc:729] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183cd91fcc73441bab4cf7ba8e2a742d, State: Initialized, Role: FOLLOWER
I20260929 06:38:02.164028 31797 consensus_queue.cc:260] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } }
I20260929 06:38:02.164379 31797 sys_catalog.cc:564] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:02.164384 31892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } } }
I20260929 06:38:02.164506 31892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [sys.catalog]: This master's current role is: FOLLOWER
W20260929 06:38:02.166121 31903 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:38:02.166230 31903 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:38:02.166347 31729 master_runner.cc:186] Error getting master registration for 127.9.61.126:41809: OK, instance_id { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" instance_seqno: 1790663881741242 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 06:38:02.169289 31729 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 06:38:02.184492 31722 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } attempt: 3
Sep 29 06:38:02 dist-test-slave-601b krb5kdc[31641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663881, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for kudu/127.9.61.124@KRBTEST.COM
I20260929 06:38:02.193209 31724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.184841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:40573 (local address 127.0.0.1:47554)
0929 06:38:02.184906 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:02.184918 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:02.184959 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:02.185126 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:02.185127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:02.185323 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:02.185382 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:02.185384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.186654 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.186656 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:02.187497 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:02.187501 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.188012 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.188013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:02.188084 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.188615 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:02.188621 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:02.190218 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:02.192070 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:02.192071 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:02.192071 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:02.192292 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:02.192521 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:02.192522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:02.192523 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:02.192590 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:02.192868 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:02.192869 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:02.192914 (+ 45us) client_negotiation.cc:769] Sending connection context
0929 06:38:02.192974 (+ 60us) client_negotiation.cc:240] Negotiation successful
0929 06:38:02.193072 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260929 06:38:02.193684 31876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.184926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47554 (local address 127.9.61.124:40573)
0929 06:38:02.184971 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.184973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.184984 (+ 11us) server_negotiation.cc:407] Connection header received
0929 06:38:02.185015 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.185016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.185026 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.185103 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.185498 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.186562 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.187590 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.187896 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.188014 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.190298 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:02.190300 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:02.190300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:02.190307 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:02.191990 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.192369 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.192370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.192371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.192433 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.192657 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.192658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.192658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.192786 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:02.192843 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:02.193521 (+ 678us) server_negotiation.cc:299] Negotiation successful
0929 06:38:02.193597 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:38:02.195562 31722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72: Bootstrap starting.
I20260929 06:38:02.196422 31722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:02.196702 31722 log.cc:824] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:02.197603 31722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72: No bootstrap required, opened a new log
I20260929 06:38:02.198920 31722 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } }
I20260929 06:38:02.199071 31722 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba35993edb934b63acd9e8d9631cea72, State: Initialized, Role: FOLLOWER
I20260929 06:38:02.199167 31722 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } }
I20260929 06:38:02.199448 31722 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:02.199462 31696 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 06:38:02.199533 31696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:02.200381 31696 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } }
I20260929 06:38:02.200626 31696 leader_election.cc:288] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [CANDIDATE]: Term 1 election: Requested vote from peers 183cd91fcc73441bab4cf7ba8e2a742d (127.9.61.125:41365), 79d18ae4d8f44c0f8b46efe353d62dfa (127.9.61.124:40573)
I20260929 06:38:02.201232 31771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ba35993edb934b63acd9e8d9631cea72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "183cd91fcc73441bab4cf7ba8e2a742d"
I20260929 06:38:02.201546 31771 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:02.202471 31771 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba35993edb934b63acd9e8d9631cea72 in term 1.
I20260929 06:38:02.202714 31671 leader_election.cc:302] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183cd91fcc73441bab4cf7ba8e2a742d, ba35993edb934b63acd9e8d9631cea72; no voters:
I20260929 06:38:02.204087 31846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ba35993edb934b63acd9e8d9631cea72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa"
I20260929 06:38:02.204214 31846 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:02.204989 31846 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba35993edb934b63acd9e8d9631cea72 in term 1.
I20260929 06:38:02.205529 31906 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } } }
I20260929 06:38:02.205637 31906 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:02.205698 31906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:02.205755 31906 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [term 1 LEADER]: Becoming Leader. State: Replica: ba35993edb934b63acd9e8d9631cea72, State: Running, Role: LEADER
I20260929 06:38:02.205830 31906 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } }
I20260929 06:38:02.205968 31654 master_runner.cc:263] No leader master found from master ba35993edb934b63acd9e8d9631cea72
I20260929 06:38:02.206029 31654 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 06:38:02.206241 31906 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba35993edb934b63acd9e8d9631cea72. Latest consensus state: current_term: 1 leader_uuid: "ba35993edb934b63acd9e8d9631cea72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } } }
I20260929 06:38:02.206316 31906 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:02.207003 31926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:02.207468 31926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:02.218351 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.203584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60558 (local address 127.9.61.126:41809)
0929 06:38:02.203624 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.203626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.208320 (+ 4694us) server_negotiation.cc:407] Connection header received
0929 06:38:02.208418 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.208419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.208429 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.208457 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.209223 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.209968 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.210992 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.211265 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.211311 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.215438 (+ 4127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:02.215440 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:02.215440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:02.215447 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:02.217205 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.217556 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.217557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.217557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.217606 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.217821 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.217822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.217823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.217941 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:02.218007 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:02.218190 (+ 183us) server_negotiation.cc:299] Negotiation successful
0929 06:38:02.218260 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:02.223650 31876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.205410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47566 (local address 127.9.61.124:40573)
0929 06:38:02.205477 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.205479 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.213056 (+ 7577us) server_negotiation.cc:407] Connection header received
0929 06:38:02.213156 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.213157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.213170 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.213201 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.213833 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.214487 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.218729 (+ 4242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.219025 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.219066 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.220556 (+ 1490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:02.220557 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:02.220557 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:02.220564 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:02.222364 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.222792 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.222793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.222793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.222847 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.223046 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.223047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.223047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.223176 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:02.223257 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:02.223447 (+ 190us) server_negotiation.cc:299] Negotiation successful
0929 06:38:02.223515 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260929 06:38:02.224556 31802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:02.206583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47052 (local address 127.9.61.125:41365)
0929 06:38:02.206621 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.206623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.216088 (+ 9465us) server_negotiation.cc:407] Connection header received
0929 06:38:02.216204 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.216205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.216216 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.216248 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.216907 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.217604 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.218576 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:02.218870 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:02.218908 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:02.221618 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:02.221619 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:02.221619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:02.221627 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:02.223310 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.223669 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.223670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.223670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.223728 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:02.223983 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:02.223983 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:02.223984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:02.224108 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:02.224196 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:02.224418 (+ 222us) server_negotiation.cc:299] Negotiation successful
0929 06:38:02.224496 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:38:02.225337 31846 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [term 1 FOLLOWER]: Refusing update from remote peer ba35993edb934b63acd9e8d9631cea72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:02.225739 31771 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [term 1 FOLLOWER]: Refusing update from remote peer ba35993edb934b63acd9e8d9631cea72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:02.226058 31918 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:02.226432 31918 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:02.227691 31892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba35993edb934b63acd9e8d9631cea72. Latest consensus state: current_term: 1 leader_uuid: "ba35993edb934b63acd9e8d9631cea72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } } }
I20260929 06:38:02.227777 31892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:02.228760 31878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba35993edb934b63acd9e8d9631cea72. Latest consensus state: current_term: 1 leader_uuid: "ba35993edb934b63acd9e8d9631cea72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } } }
I20260929 06:38:02.228893 31878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:02.237372 31918 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ba35993edb934b63acd9e8d9631cea72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } } }
I20260929 06:38:02.237468 31918 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:02.237551 31929 mvcc.cc:205] Tried to move back new op lower bound from 7334559261573865472 to 7334559261515743232. Current Snapshot: MvccSnapshot[applied={T|T < 7334559261573865472}]
I20260929 06:38:02.237911 31906 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ba35993edb934b63acd9e8d9631cea72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } } }
I20260929 06:38:02.237989 31906 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:02.238458 31878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ba35993edb934b63acd9e8d9631cea72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } } }
I20260929 06:38:02.238548 31878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:02.238992 31932 mvcc.cc:205] Tried to move back new op lower bound from 7334559261573865472 to 7334559261515743232. Current Snapshot: MvccSnapshot[applied={T|T < 7334559261573865472}]
I20260929 06:38:02.239144 31892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ba35993edb934b63acd9e8d9631cea72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba35993edb934b63acd9e8d9631cea72" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 41809 } } peers { permanent_uuid: "183cd91fcc73441bab4cf7ba8e2a742d" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 41365 } } peers { permanent_uuid: "79d18ae4d8f44c0f8b46efe353d62dfa" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 40573 } } }
I20260929 06:38:02.239231 31892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:02.239420 31930 mvcc.cc:205] Tried to move back new op lower bound from 7334559261573865472 to 7334559261515743232. Current Snapshot: MvccSnapshot[applied={T|T < 7334559261573865472}]
I20260929 06:38:02.239609 31926 catalog_manager.cc:1347] Generated new cluster ID: 4fcac15bd707403780837bfcfdb3b6a5
I20260929 06:38:02.239655 31926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:02.259589 31926 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:02.260455 31926 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:02.275077 31926 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba35993edb934b63acd9e8d9631cea72: Generated new TSK 0
I20260929 06:38:02.275382 31926 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 06:38:02.307235 31802 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.306078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57602 (local address 127.9.61.125:41365)
0929 06:38:02.306119 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.306121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.306470 (+ 349us) server_negotiation.cc:407] Connection header received
0929 06:38:02.306585 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.306586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.306598 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.306631 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.307160 (+ 529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57602: BlockingRecv error: recv got EOF from 127.0.0.1:57602 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260929 06:38:02.307229 31725 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.305666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42934 (local address 127.9.61.126:41809)
0929 06:38:02.305739 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.305741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.306470 (+ 729us) server_negotiation.cc:407] Connection header received
0929 06:38:02.306585 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.306586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.306598 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.306631 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.307160 (+ 529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42934: BlockingRecv error: recv got EOF from 127.0.0.1:42934 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260929 06:38:02.308089 31876 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.306187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50844 (local address 127.9.61.124:40573)
0929 06:38:02.306222 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.306224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.307531 (+ 1307us) server_negotiation.cc:407] Connection header received
0929 06:38:02.307626 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.307627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.307638 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.307666 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.308031 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50844: BlockingRecv error: recv got EOF from 127.0.0.1:50844 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 06:38:02.309795 31802 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.309059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57606 (local address 127.9.61.125:41365)
0929 06:38:02.309099 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.309100 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.309307 (+ 207us) server_negotiation.cc:407] Connection header received
0929 06:38:02.309383 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.309384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.309400 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.309465 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.309735 (+ 270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57606: BlockingRecv error: recv got EOF from 127.0.0.1:57606 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 06:38:02.312335 31802 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.311841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57622 (local address 127.9.61.125:41365)
0929 06:38:02.311876 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.311877 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.311884 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:02.311961 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.311962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.311971 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.312020 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.312276 (+ 256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57622: BlockingRecv error: recv got EOF from 127.0.0.1:57622 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 06:38:02.315693 31802 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.315135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57632 (local address 127.9.61.125:41365)
0929 06:38:02.315174 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.315176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.315248 (+ 72us) server_negotiation.cc:407] Connection header received
0929 06:38:02.315321 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.315322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.315332 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.315387 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.315641 (+ 254us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57632: BlockingRecv error: recv got EOF from 127.0.0.1:57632 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 06:38:02.321169 31802 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.320569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57648 (local address 127.9.61.125:41365)
0929 06:38:02.320605 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.320607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.320704 (+ 97us) server_negotiation.cc:407] Connection header received
0929 06:38:02.320778 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.320778 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.320788 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.320839 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.321099 (+ 260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57648: BlockingRecv error: recv got EOF from 127.0.0.1:57648 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260929 06:38:02.330802 31802 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.330150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57660 (local address 127.9.61.125:41365)
0929 06:38:02.330195 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.330197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.330309 (+ 112us) server_negotiation.cc:407] Connection header received
0929 06:38:02.330384 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.330385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.330395 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.330451 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.330738 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57660: BlockingRecv error: recv got EOF from 127.0.0.1:57660 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260929 06:38:02.348615 31802 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.347841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57664 (local address 127.9.61.125:41365)
0929 06:38:02.347885 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.347888 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.348058 (+ 170us) server_negotiation.cc:407] Connection header received
0929 06:38:02.348142 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.348143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.348160 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.348226 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.348544 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57664: BlockingRecv error: recv got EOF from 127.0.0.1:57664 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260929 06:38:02.382345 31802 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.381694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57678 (local address 127.9.61.125:41365)
0929 06:38:02.381780 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.381782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.381796 (+ 14us) server_negotiation.cc:407] Connection header received
0929 06:38:02.381855 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.381856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.381869 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.381945 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.382286 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57678: BlockingRecv error: recv got EOF from 127.0.0.1:57678 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260929 06:38:02.448103 31802 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.447476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57686 (local address 127.9.61.125:41365)
0929 06:38:02.447533 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.447535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.447601 (+ 66us) server_negotiation.cc:407] Connection header received
0929 06:38:02.447649 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.447650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.447660 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.447722 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.448055 (+ 333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57686: BlockingRecv error: recv got EOF from 127.0.0.1:57686 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260929 06:38:02.578177 31802 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.577525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57690 (local address 127.9.61.125:41365)
0929 06:38:02.577579 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.577581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.577678 (+ 97us) server_negotiation.cc:407] Connection header received
0929 06:38:02.577747 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.577747 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.577757 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.577802 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.578130 (+ 328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57690: BlockingRecv error: recv got EOF from 127.0.0.1:57690 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260929 06:38:02.836105 31802 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:02.835491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57704 (local address 127.9.61.125:41365)
0929 06:38:02.835551 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:02.835553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:02.835576 (+ 23us) server_negotiation.cc:407] Connection header received
0929 06:38:02.835649 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:02.835649 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:02.835659 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:02.835721 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:02.836057 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57704: BlockingRecv error: recv got EOF from 127.0.0.1:57704 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260929 06:38:03.130484 31889 catalog_manager.cc:1259] Loaded cluster ID: 4fcac15bd707403780837bfcfdb3b6a5
I20260929 06:38:03.130563 31889 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa: loading cluster ID for follower catalog manager: success
I20260929 06:38:03.131371 31889 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa: acquiring CA information for follower catalog manager: success
I20260929 06:38:03.131678 31889 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 79d18ae4d8f44c0f8b46efe353d62dfa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:38:03.166705 31903 catalog_manager.cc:1259] Loaded cluster ID: 4fcac15bd707403780837bfcfdb3b6a5
I20260929 06:38:03.166790 31903 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d: loading cluster ID for follower catalog manager: success
I20260929 06:38:03.167646 31903 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d: acquiring CA information for follower catalog manager: success
I20260929 06:38:03.167986 31903 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 183cd91fcc73441bab4cf7ba8e2a742d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:38:03.351979 32003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:03.349434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57710 (local address 127.9.61.125:41365)
0929 06:38:03.349547 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:03.349548 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:03.349557 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:03.349617 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:03.349618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:03.349674 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:03.349745 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:03.349885 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:03.350410 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:03.351250 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:03.351438 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:03.351493 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:03.351630 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:03.351743 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:03.351800 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:03.351835 (+ 35us) server_negotiation.cc:299] Negotiation successful
0929 06:38:03.351853 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":66,"threads_started":1}
I20260929 06:38:03.356384 32009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:03.353876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50854 (local address 127.9.61.124:40573)
0929 06:38:03.353974 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:03.353976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:03.354002 (+ 26us) server_negotiation.cc:407] Connection header received
0929 06:38:03.354034 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:03.354035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:03.354066 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:03.354124 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:03.354237 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:03.354697 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:03.355494 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:03.355707 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:03.355772 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:03.356010 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:03.356147 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:03.356247 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:03.356271 (+ 24us) server_negotiation.cc:299] Negotiation successful
0929 06:38:03.356293 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":51,"threads_started":1}
I20260929 06:38:03.360982 32009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:03.358082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50862 (local address 127.9.61.124:40573)
0929 06:38:03.358225 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:03.358226 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:03.358330 (+ 104us) server_negotiation.cc:407] Connection header received
0929 06:38:03.358355 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:03.358356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:03.358367 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:03.358422 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:03.358509 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:03.359200 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:03.360202 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:03.360399 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:03.360473 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:03.360629 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:03.360668 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:03.360708 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:03.360865 (+ 157us) server_negotiation.cc:299] Negotiation successful
0929 06:38:03.360884 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260929 06:38:03.361399 32014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:03.358027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42938 (local address 127.9.61.126:41809)
0929 06:38:03.358140 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:03.358142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:03.358271 (+ 129us) server_negotiation.cc:407] Connection header received
0929 06:38:03.358405 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:03.358406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:03.358454 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:03.358549 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:03.358711 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:03.359199 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:03.360476 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:03.360695 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:03.360781 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:03.360979 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:03.361085 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:03.361168 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:03.361287 (+ 119us) server_negotiation.cc:299] Negotiation successful
0929 06:38:03.361314 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":54,"threads_started":1}
I20260929 06:38:03.361393 32003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:03.358006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57718 (local address 127.9.61.125:41365)
0929 06:38:03.358056 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:03.358058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:03.358255 (+ 197us) server_negotiation.cc:407] Connection header received
0929 06:38:03.358323 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:03.358324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:03.358336 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:03.358386 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:03.358721 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:03.359431 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:03.360447 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:03.360736 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:03.360794 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:03.360986 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:03.361018 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:03.361066 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:03.361277 (+ 211us) server_negotiation.cc:299] Negotiation successful
0929 06:38:03.361299 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260929 06:38:03.363034 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 31654
I20260929 06:38:03.368512 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 31729
I20260929 06:38:03.373610 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 31804
2026-09-29T06:38:03Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2939 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 29 06:38:03 dist-test-slave-601b krb5kdc[32020](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 29 06:38:03 dist-test-slave-601b krb5kdc[32020](info): set up 2 sockets
Sep 29 06:38:03 dist-test-slave-601b krb5kdc[32020](info): commencing operation
krb5kdc: starting...
W20260929 06:38:04.400187 9461 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/test-user.keytab.
Sep 29 06:38:04 dist-test-slave-601b krb5kdc[32020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-29T06:38:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-29T06:38:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.61.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
Entry for principal kudu/127.9.61.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab.
I20260929 06:38:04.516873 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:43691
--webserver_interface=127.9.61.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:43691,127.9.61.125:38005,127.9.61.124:42295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260929 06:38:04.598821 32033 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 06:38:04.599144 32033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:04.599201 32033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:04.599248 32033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:04.601475 32033 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:04.601542 32033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:04.601567 32033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:04.601588 32033 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:04.601605 32033 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:04.604480 32033 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:43691,127.9.61.125:38005,127.9.61.124:42295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.126.keytab
--principal=kudu/127.9.61.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.126:43691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.61.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:04.604846 32033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:04.605147 32033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:04.610788 32041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:04.610894 32039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:04.610812 32038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:04.611052 32033 server_base.cc:1034] running on GCE node
I20260929 06:38:04.611306 32033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:04.611562 32033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:04.612717 32033 hybrid_clock.cc:648] HybridClock initialized: now 1790663884612699 us; error 31 us; skew 500 ppm
Sep 29 06:38:04 dist-test-slave-601b krb5kdc[32020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:04.615274 32033 init.cc:377] Logged in from keytab as kudu/127.9.61.126@KRBTEST.COM (short username kudu)
I20260929 06:38:04.615774 32033 webserver.cc:460] Webserver started at http://127.9.61.126:42857/ using document root <none> and password file <none>
I20260929 06:38:04.616027 32033 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:04.616077 32033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:04.616184 32033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:04.617247 32033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/data/instance:
uuid: "23144c96e6294ef794aa94e802785ae4"
format_stamp: "Formatted at 2026-09-29 06:38:04 on dist-test-slave-601b"
server_key: "2cd24bd8a5ab06efb12cb50adceda398"
server_key_iv: "f54107e1d07b3ee875c4c1fda3793b04"
server_key_version: "encryptionkey@0"
I20260929 06:38:04.617553 32033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/wal/instance:
uuid: "23144c96e6294ef794aa94e802785ae4"
format_stamp: "Formatted at 2026-09-29 06:38:04 on dist-test-slave-601b"
server_key: "2cd24bd8a5ab06efb12cb50adceda398"
server_key_iv: "f54107e1d07b3ee875c4c1fda3793b04"
server_key_version: "encryptionkey@0"
I20260929 06:38:04.618842 32033 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260929 06:38:04.619570 32048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:04.619760 32033 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260929 06:38:04.619865 32033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/wal
uuid: "23144c96e6294ef794aa94e802785ae4"
format_stamp: "Formatted at 2026-09-29 06:38:04 on dist-test-slave-601b"
server_key: "2cd24bd8a5ab06efb12cb50adceda398"
server_key_iv: "f54107e1d07b3ee875c4c1fda3793b04"
server_key_version: "encryptionkey@0"
I20260929 06:38:04.619943 32033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:04.635828 32033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:04.637866 32033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:04.638051 32033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:04.642395 32033 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.126:43691
I20260929 06:38:04.642445 32100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.126:43691 every 8 connection(s)
I20260929 06:38:04.642827 32033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/data/info.pb
I20260929 06:38:04.643814 32101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:04.645475 32101 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:38:04 dist-test-slave-601b krb5kdc[32020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:38:04.651839 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 32033
I20260929 06:38:04.652001 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-0/wal/instance
I20260929 06:38:04.652207 9461 external_mini_cluster.cc:1428] Setting key 06f861f28f812cc59b069f20f6c789b2
I20260929 06:38:04.656452 32103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.646281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33954 (local address 127.9.61.126:43691)
0929 06:38:04.646470 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:04.646479 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:04.646653 (+ 174us) server_negotiation.cc:407] Connection header received
0929 06:38:04.647133 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:04.647135 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:04.647167 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:04.647258 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:04.647837 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.648796 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.649729 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.650051 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.650135 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:04.652510 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:04.652517 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:04.652517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:04.652524 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:04.654646 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:04.655138 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:04.655147 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:04.655147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:04.655231 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:04.655500 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:04.655501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:04.655501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:04.655753 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:04.655819 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:04.656102 (+ 283us) server_negotiation.cc:299] Negotiation successful
0929 06:38:04.656258 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"spinlock_wait_cycles":9600,"thread_start_us":103,"threads_started":1}
I20260929 06:38:04.656560 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.646262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:43691 (local address 127.0.0.1:33954)
0929 06:38:04.646527 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.646558 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:04.647008 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:04.647296 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:04.647298 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:04.647567 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:04.647731 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:04.647735 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.648917 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.648918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:04.649647 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:04.649649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.650148 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.650149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:04.650240 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:04.650783 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:04.650792 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:04.652401 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:04.654735 (+ 2334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:04.654742 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:04.654744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:04.655054 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:04.655302 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:04.655303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:04.655303 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:04.655431 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:04.655830 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:04.655837 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:04.655924 (+ 87us) client_negotiation.cc:769] Sending connection context
0929 06:38:04.656058 (+ 134us) client_negotiation.cc:240] Negotiation successful
0929 06:38:04.656385 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":120,"thread_start_us":110,"threads_started":1}
I20260929 06:38:04.657321 32101 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:04.657727 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.657577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:38005 (local address 127.0.0.1:53692)
0929 06:38:04.657634 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.657690 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:38005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 06:38:04.657917 32051 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.61.125:38005: connect: Connection refused (error 111)
I20260929 06:38:04.658425 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.658302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:38005 (local address 127.0.0.1:53706)
0929 06:38:04.658355 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.658394 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:38005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260929 06:38:04.658545 32101 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.125:38005: Network error: Client connection negotiation failed: client connection to 127.9.61.125:38005: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.9.61.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.125.keytab.
Entry for principal kudu/127.9.61.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.125.keytab.
I20260929 06:38:04.679247 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.125:38005
--webserver_interface=127.9.61.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.125.keytab
--principal=kudu/127.9.61.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:43691,127.9.61.125:38005,127.9.61.124:42295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:38:04.707862 32101 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } attempt: 1
I20260929 06:38:04.708648 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.708301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:38005 (local address 127.0.0.1:53710)
0929 06:38:04.708562 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.708611 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:38005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231}
I20260929 06:38:04.709761 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.709649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:38005 (local address 127.0.0.1:53722)
0929 06:38:04.709699 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.709734 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:38005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 06:38:04.709913 32101 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.125:38005: Network error: Client connection negotiation failed: client connection to 127.9.61.125:38005: connect: Connection refused (error 111)
W20260929 06:38:04.762620 32108 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 06:38:04.762849 32108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:04.762866 32108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:04.762887 32108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:04.764154 32108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:04.764199 32108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:04.764214 32108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:04.764227 32108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:04.764240 32108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:04.765751 32108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:43691,127.9.61.125:38005,127.9.61.124:42295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.125.keytab
--principal=kudu/127.9.61.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.125:38005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.61.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:04.766012 32108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:04.766275 32108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:04.771292 32114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:04.771284 32113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:04.771453 32108 server_base.cc:1034] running on GCE node
W20260929 06:38:04.771262 32116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:04.771796 32108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:04.772125 32108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:04.773283 32108 hybrid_clock.cc:648] HybridClock initialized: now 1790663884773259 us; error 46 us; skew 500 ppm
Sep 29 06:38:04 dist-test-slave-601b krb5kdc[32020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:04.775831 32108 init.cc:377] Logged in from keytab as kudu/127.9.61.125@KRBTEST.COM (short username kudu)
I20260929 06:38:04.776330 32108 webserver.cc:460] Webserver started at http://127.9.61.125:46771/ using document root <none> and password file <none>
I20260929 06:38:04.776587 32108 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:04.776659 32108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:04.776810 32108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:04.777931 32108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/data/instance:
uuid: "1b06cb5664c944738236040704ec6cbc"
format_stamp: "Formatted at 2026-09-29 06:38:04 on dist-test-slave-601b"
server_key: "495e6a096d72e6bd4a2b0f82a5547ef4"
server_key_iv: "11cdf67e1daa3ca4e4a3229d9cc91319"
server_key_version: "encryptionkey@0"
I20260929 06:38:04.778128 32101 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } attempt: 2
I20260929 06:38:04.778353 32108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/wal/instance:
uuid: "1b06cb5664c944738236040704ec6cbc"
format_stamp: "Formatted at 2026-09-29 06:38:04 on dist-test-slave-601b"
server_key: "495e6a096d72e6bd4a2b0f82a5547ef4"
server_key_iv: "11cdf67e1daa3ca4e4a3229d9cc91319"
server_key_version: "encryptionkey@0"
I20260929 06:38:04.778553 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.778393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:38005 (local address 127.0.0.1:53734)
0929 06:38:04.778472 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.778513 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:38005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260929 06:38:04.778945 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.778841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:38005 (local address 127.0.0.1:53750)
0929 06:38:04.778899 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.778925 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.125:38005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260929 06:38:04.779076 32101 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.125:38005: Network error: Client connection negotiation failed: client connection to 127.9.61.125:38005: connect: Connection refused (error 111)
I20260929 06:38:04.779912 32108 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260929 06:38:04.780725 32123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:04.780938 32108 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:04.781033 32108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/wal
uuid: "1b06cb5664c944738236040704ec6cbc"
format_stamp: "Formatted at 2026-09-29 06:38:04 on dist-test-slave-601b"
server_key: "495e6a096d72e6bd4a2b0f82a5547ef4"
server_key_iv: "11cdf67e1daa3ca4e4a3229d9cc91319"
server_key_version: "encryptionkey@0"
I20260929 06:38:04.781122 32108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:04.804534 32108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:04.807065 32108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:04.807183 32108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:04.811363 32108 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.125:38005
I20260929 06:38:04.811456 32175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.125:38005 every 8 connection(s)
I20260929 06:38:04.811796 32108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/data/info.pb
I20260929 06:38:04.812875 32176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:04.814632 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 32108
I20260929 06:38:04.814488 32176 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:04.814726 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-1/wal/instance
I20260929 06:38:04.814901 9461 external_mini_cluster.cc:1428] Setting key 637440234758cc97600125a88f7e54de
Sep 29 06:38:04 dist-test-slave-601b krb5kdc[32020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.125@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.61.124@KRBTEST.COM; defaulting to no policy
I20260929 06:38:04.824576 32103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.815248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33964 (local address 127.9.61.126:43691)
0929 06:38:04.815314 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:04.815316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:04.815527 (+ 211us) server_negotiation.cc:407] Connection header received
0929 06:38:04.816054 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:04.816056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:04.816073 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:04.816131 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:04.816962 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.817473 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.818518 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.818758 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.818851 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:04.821505 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:04.821508 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:04.821508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:04.821519 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:04.823067 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:04.823542 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:04.823543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:04.823543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:04.823599 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:04.823893 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:04.823894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:04.823894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:04.824048 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:04.824101 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:04.824405 (+ 304us) server_negotiation.cc:299] Negotiation successful
0929 06:38:04.824511 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:38:04.824633 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.815212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:43691 (local address 127.0.0.1:33964)
0929 06:38:04.815376 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.815419 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:04.815907 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:04.816213 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:04.816216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:04.816589 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:04.816861 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:04.816867 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.817588 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.817590 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:04.818415 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:04.818418 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.818881 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.818883 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:04.819006 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:04.819662 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:04.819671 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:04.821395 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:04.823183 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:04.823189 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:04.823191 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:04.823461 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:04.823703 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:04.823704 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:04.823705 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:04.823827 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:04.824107 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:04.824112 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:04.824238 (+ 126us) client_negotiation.cc:769] Sending connection context
0929 06:38:04.824328 (+ 90us) client_negotiation.cc:240] Negotiation successful
0929 06:38:04.824460 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.61.124@KRBTEST.COM" created.
I20260929 06:38:04.825342 32176 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:38:04 dist-test-slave-601b krb5kdc[32020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.125@KRBTEST.COM for kudu/127.9.61.125@KRBTEST.COM
I20260929 06:38:04.833384 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.825673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:38005 (local address 127.0.0.1:53752)
0929 06:38:04.825733 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.825746 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:04.825792 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:04.826023 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:04.826024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:04.826196 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:04.826262 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:04.826264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.827530 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.827531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:04.828102 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:04.828104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.828622 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.828623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:04.828687 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:04.829206 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:04.829211 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:04.830402 (+ 1191us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:04.832270 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:04.832271 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:04.832271 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:04.832445 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:04.832667 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:04.832668 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:04.832668 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:04.832722 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:04.833039 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:04.833039 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:04.833079 (+ 40us) client_negotiation.cc:769] Sending connection context
0929 06:38:04.833146 (+ 67us) client_negotiation.cc:240] Negotiation successful
0929 06:38:04.833256 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260929 06:38:04.833401 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.825712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53752 (local address 127.9.61.125:38005)
0929 06:38:04.825875 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:04.825880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:04.825898 (+ 18us) server_negotiation.cc:407] Connection header received
0929 06:38:04.825926 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:04.825928 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:04.825939 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:04.826007 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:04.826337 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.827432 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.828197 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.828531 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.828622 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:04.830490 (+ 1868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:04.830499 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:04.830499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:04.830506 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:04.832175 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:04.832540 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:04.832543 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:04.832544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:04.832600 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:04.832794 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:04.832795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:04.832795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:04.832960 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:04.833049 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:04.833187 (+ 138us) server_negotiation.cc:299] Negotiation successful
0929 06:38:04.833308 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":134,"thread_start_us":105,"threads_started":1}
I20260929 06:38:04.834327 32176 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:04.834692 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.834546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39094)
0929 06:38:04.834604 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.834656 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260929 06:38:04.834836 32124 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
I20260929 06:38:04.835300 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.835189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39098)
0929 06:38:04.835244 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.835269 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260929 06:38:04.835400 32176 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:42295: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.61.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.124.keytab.
Entry for principal kudu/127.9.61.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.124.keytab.
I20260929 06:38:04.841264 9461 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskA6qGeu/build/release/bin/kudu
/tmp/dist-test-taskA6qGeu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.124:42295
--webserver_interface=127.9.61.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.124.keytab
--principal=kudu/127.9.61.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.61.84:34917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.61.126:43691,127.9.61.125:38005,127.9.61.124:42295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260929 06:38:04.870253 32101 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } attempt: 3
Sep 29 06:38:04 dist-test-slave-601b krb5kdc[32020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for kudu/127.9.61.125@KRBTEST.COM
I20260929 06:38:04.878150 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.870799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53754 (local address 127.9.61.125:38005)
0929 06:38:04.870882 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:04.870884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:04.870894 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:04.870948 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:04.870948 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:04.870960 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:04.871012 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:04.871416 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.871989 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.873020 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.873259 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.873319 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:04.875494 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:04.875495 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:04.875496 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:04.875503 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:04.877038 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:04.877448 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:04.877448 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:04.877449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:04.877500 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:04.877696 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:04.877696 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:04.877697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:04.877803 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:04.877852 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:04.878013 (+ 161us) server_negotiation.cc:299] Negotiation successful
0929 06:38:04.878078 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260929 06:38:04.878186 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.870712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:38005 (local address 127.0.0.1:53754)
0929 06:38:04.870792 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.870807 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:04.870882 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:04.871040 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:04.871042 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:04.871245 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:04.871326 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:04.871328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.872080 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.872081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:04.872908 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:04.872910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.873340 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.873342 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:04.873422 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:04.873934 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:04.873945 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:04.875394 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:04.877126 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:04.877127 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:04.877127 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:04.877371 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:04.877563 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:04.877564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:04.877565 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:04.877631 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:04.877863 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:04.877864 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:04.877919 (+ 55us) client_negotiation.cc:769] Sending connection context
0929 06:38:04.877988 (+ 69us) client_negotiation.cc:240] Negotiation successful
0929 06:38:04.878088 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260929 06:38:04.878885 32101 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:04.879258 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.879141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39114)
0929 06:38:04.879194 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.879230 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260929 06:38:04.879622 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.879525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39130)
0929 06:38:04.879576 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.879603 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260929 06:38:04.879766 32101 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:42295: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
I20260929 06:38:04.884598 32176 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } attempt: 1
I20260929 06:38:04.885010 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.884882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39136)
0929 06:38:04.884940 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.884975 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260929 06:38:04.885370 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.885254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39142)
0929 06:38:04.885300 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.885328 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260929 06:38:04.885458 32176 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:42295: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
I20260929 06:38:04.910943 32101 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } attempt: 1
I20260929 06:38:04.911499 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.911321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39148)
0929 06:38:04.911394 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.911450 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260929 06:38:04.911965 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.911836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39158)
0929 06:38:04.911895 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.911926 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260929 06:38:04.912056 32101 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:42295: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
W20260929 06:38:04.928992 32183 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260929 06:38:04.929226 32183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260929 06:38:04.929245 32183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260929 06:38:04.929267 32183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260929 06:38:04.930480 32183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260929 06:38:04.930522 32183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260929 06:38:04.930537 32183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260929 06:38:04.930550 32183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260929 06:38:04.930563 32183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260929 06:38:04.932142 32183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.61.84:34917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.61.126:43691,127.9.61.125:38005,127.9.61.124:42295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/krb5kdc/kudu_127.9.61.124.keytab
--principal=kudu/127.9.61.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.61.124:42295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.61.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 29 Sep 2026 05:41:51 UTC on ccycloud.quasar-zzupah.root.comops.site
build id 4679345
I20260929 06:38:04.932363 32183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 06:38:04.932554 32183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 06:38:04.937458 32189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:04.937495 32191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 06:38:04.937495 32188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 06:38:04.937623 32183 server_base.cc:1034] running on GCE node
I20260929 06:38:04.937908 32183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260929 06:38:04.938217 32183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260929 06:38:04.939383 32183 hybrid_clock.cc:648] HybridClock initialized: now 1790663884939341 us; error 47 us; skew 500 ppm
Sep 29 06:38:04 dist-test-slave-601b krb5kdc[32020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260929 06:38:04.942070 32183 init.cc:377] Logged in from keytab as kudu/127.9.61.124@KRBTEST.COM (short username kudu)
I20260929 06:38:04.942514 32183 webserver.cc:460] Webserver started at http://127.9.61.124:33889/ using document root <none> and password file <none>
I20260929 06:38:04.942705 32183 fs_manager.cc:359] Metadata directory not provided
I20260929 06:38:04.942749 32183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 06:38:04.942842 32183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 06:38:04.943928 32183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/data/instance:
uuid: "55c15b393bed4a64a109d51637d7bc72"
format_stamp: "Formatted at 2026-09-29 06:38:04 on dist-test-slave-601b"
server_key: "ba65e32251c390918e7b917a9cf7943b"
server_key_iv: "bb06f1846dec516f80a608e7025d5820"
server_key_version: "encryptionkey@0"
I20260929 06:38:04.944329 32183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/wal/instance:
uuid: "55c15b393bed4a64a109d51637d7bc72"
format_stamp: "Formatted at 2026-09-29 06:38:04 on dist-test-slave-601b"
server_key: "ba65e32251c390918e7b917a9cf7943b"
server_key_iv: "bb06f1846dec516f80a608e7025d5820"
server_key_version: "encryptionkey@0"
I20260929 06:38:04.945643 32183 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:04.946408 32198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 06:38:04.946617 32183 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260929 06:38:04.946739 32183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/data,/tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/wal
uuid: "55c15b393bed4a64a109d51637d7bc72"
format_stamp: "Formatted at 2026-09-29 06:38:04 on dist-test-slave-601b"
server_key: "ba65e32251c390918e7b917a9cf7943b"
server_key_iv: "bb06f1846dec516f80a608e7025d5820"
server_key_version: "encryptionkey@0"
I20260929 06:38:04.946820 32183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 06:38:04.953603 32176 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } attempt: 2
I20260929 06:38:04.954052 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.953918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39164)
0929 06:38:04.953980 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.954022 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260929 06:38:04.954427 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.954328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39170)
0929 06:38:04.954373 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.954398 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260929 06:38:04.954516 32176 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:42295: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
I20260929 06:38:04.983301 32183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 06:38:04.985816 32183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 06:38:04.985935 32183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 06:38:04.987202 32101 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } attempt: 2
I20260929 06:38:04.987708 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.987545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39180)
0929 06:38:04.987609 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.987645 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260929 06:38:04.988227 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.988142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39190)
0929 06:38:04.988174 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.988205 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260929 06:38:04.988365 32101 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.61.124:42295: Network error: Client connection negotiation failed: client connection to 127.9.61.124:42295: connect: Connection refused (error 111)
I20260929 06:38:04.990270 32183 rpc_server.cc:307] RPC server started. Bound to: 127.9.61.124:42295
I20260929 06:38:04.990298 32250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.61.124:42295 every 8 connection(s)
I20260929 06:38:04.990685 32183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/data/info.pb
I20260929 06:38:04.991696 32251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 06:38:04.993348 32251 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:04.996991 9461 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskA6qGeu/build/release/bin/kudu as pid 32183
I20260929 06:38:04.997112 9461 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskA6qGeu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790663621200347-9461-0/minicluster-data/master-2/wal/instance
I20260929 06:38:04.997339 9461 external_mini_cluster.cc:1428] Setting key 904fc9087be9babba451bb50b6ddbe11
Sep 29 06:38:04 dist-test-slave-601b krb5kdc[32020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.124@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
I20260929 06:38:05.002482 32103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.994042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33976 (local address 127.9.61.126:43691)
0929 06:38:04.994102 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:04.994104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:04.994319 (+ 215us) server_negotiation.cc:407] Connection header received
0929 06:38:04.994760 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:04.994761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:04.994771 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:04.994833 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:04.995525 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.996049 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.996994 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.997294 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.997371 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:04.999536 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:04.999538 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:04.999538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:04.999546 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:05.001114 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.001525 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.001527 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.001527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.001587 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.001843 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.001844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.001845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.001958 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:05.002035 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:05.002309 (+ 274us) server_negotiation.cc:299] Negotiation successful
0929 06:38:05.002393 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260929 06:38:05.002650 32253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.994027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.126:43691 (local address 127.0.0.1:33976)
0929 06:38:04.994195 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:04.994238 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:04.994681 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:04.994901 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:04.994904 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:04.995239 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:04.995447 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:04.995452 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.996124 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.996124 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:04.996916 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:04.996918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.997410 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:04.997412 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:04.997535 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:04.998106 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:04.998113 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:04.999451 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:05.001207 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:05.001213 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:05.001215 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:05.001425 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:05.001657 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:05.001657 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:05.001658 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:05.001773 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:05.002027 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:05.002034 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:05.002168 (+ 134us) client_negotiation.cc:769] Sending connection context
0929 06:38:05.002275 (+ 107us) client_negotiation.cc:240] Negotiation successful
0929 06:38:05.002419 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":96,"threads_started":1}
Sep 29 06:38:04 dist-test-slave-601b krb5kdc[32020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.124@KRBTEST.COM
I20260929 06:38:05.003716 32251 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } has no permanent_uuid. Determining permanent_uuid...
I20260929 06:38:05.006803 32255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:04.997733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39204 (local address 127.9.61.124:42295)
0929 06:38:04.997907 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:04.997912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:04.998055 (+ 143us) server_negotiation.cc:407] Connection header received
0929 06:38:04.998122 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:04.998125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:04.998155 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:04.998233 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:04.998862 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:04.999689 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.000663 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.001189 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.001254 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.003809 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:05.003817 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:05.003817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:05.003824 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:05.005577 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.005955 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.005958 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.005958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.006021 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.006222 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.006223 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.006224 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.006366 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:05.006538 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:05.006585 (+ 47us) server_negotiation.cc:299] Negotiation successful
0929 06:38:05.006663 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":107,"threads_started":1}
Sep 29 06:38:05 dist-test-slave-601b krb5kdc[32020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.124@KRBTEST.COM for kudu/127.9.61.125@KRBTEST.COM
I20260929 06:38:05.010942 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.004069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53764 (local address 127.9.61.125:38005)
0929 06:38:05.004137 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.004140 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.004149 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:05.004237 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.004238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.004248 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.004303 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.004567 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.005022 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.005680 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.005879 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.005971 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.007808 (+ 1837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:05.007809 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:05.007809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:05.007817 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:05.009803 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.010147 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.010148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.010148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.010209 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.010438 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.010439 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.010439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.010579 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:05.010646 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:05.010814 (+ 168us) server_negotiation.cc:299] Negotiation successful
0929 06:38:05.010878 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260929 06:38:05.011023 32253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.004036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.125:38005 (local address 127.0.0.1:53764)
0929 06:38:05.004080 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:05.004091 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:05.004178 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:05.004307 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:05.004308 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:05.004447 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:05.004489 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:05.004490 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.005102 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.005104 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:05.005591 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:05.005592 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.005969 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.005970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:05.006039 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.006445 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:05.006450 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:05.007731 (+ 1281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:05.009888 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:05.009889 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:05.009889 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:05.010048 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:05.010287 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:05.010288 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:05.010289 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:05.010354 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:05.010657 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:05.010658 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:05.010704 (+ 46us) client_negotiation.cc:769] Sending connection context
0929 06:38:05.010787 (+ 83us) client_negotiation.cc:240] Negotiation successful
0929 06:38:05.010883 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260929 06:38:05.011842 32251 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } has no permanent_uuid. Determining permanent_uuid...
Sep 29 06:38:05 dist-test-slave-601b krb5kdc[32020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.126@KRBTEST.COM
Sep 29 06:38:05 dist-test-slave-601b krb5kdc[32020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.124@KRBTEST.COM for kudu/127.9.61.124@KRBTEST.COM
I20260929 06:38:05.015617 32103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.007611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33988 (local address 127.9.61.126:43691)
0929 06:38:05.007657 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.007658 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.007667 (+ 9us) server_negotiation.cc:407] Connection header received
0929 06:38:05.007729 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.007729 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.007737 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.007807 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.008307 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.009052 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.009784 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.010037 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.010085 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.012530 (+ 2445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:05.012531 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:05.012532 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:05.012539 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:05.014507 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.014862 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.014863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.014863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.014913 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.015099 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.015099 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.015100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.015188 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:05.015308 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:05.015415 (+ 107us) server_negotiation.cc:299] Negotiation successful
0929 06:38:05.015479 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260929 06:38:05.018724 32253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.012151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39210)
0929 06:38:05.012201 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:05.012212 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:05.012251 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:05.012375 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:05.012376 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:05.012502 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:05.012527 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:05.012529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.013140 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.013141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:05.013604 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:05.013605 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.014046 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.014047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:05.014096 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.014461 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:05.014465 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:05.015756 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:05.017661 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:05.017661 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:05.017662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:05.017817 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:05.018033 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:05.018034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:05.018034 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:05.018101 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:05.018361 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:05.018362 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:05.018406 (+ 44us) client_negotiation.cc:769] Sending connection context
0929 06:38:05.018479 (+ 73us) client_negotiation.cc:240] Negotiation successful
0929 06:38:05.018570 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260929 06:38:05.018734 32255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.012235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39210 (local address 127.9.61.124:42295)
0929 06:38:05.012268 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.012270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.012277 (+ 7us) server_negotiation.cc:407] Connection header received
0929 06:38:05.012296 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.012297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.012306 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.012355 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.012609 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.013064 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.013693 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.013964 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.014046 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.015861 (+ 1815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:05.015862 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:05.015862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:05.015869 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:05.017583 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.017925 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.017926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.017926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.017974 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.018202 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.018203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.018203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.018296 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:05.018347 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:05.018495 (+ 148us) server_negotiation.cc:299] Negotiation successful
0929 06:38:05.018610 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":17}
I20260929 06:38:05.020617 32251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72: Bootstrap starting.
Sep 29 06:38:05 dist-test-slave-601b krb5kdc[32020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.61.125@KRBTEST.COM
I20260929 06:38:05.021555 32251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:05.021884 32251 log.cc:824] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:05.022800 32251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72: No bootstrap required, opened a new log
I20260929 06:38:05.024219 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.016411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53772 (local address 127.9.61.125:38005)
0929 06:38:05.016449 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.016450 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.016473 (+ 23us) server_negotiation.cc:407] Connection header received
0929 06:38:05.016494 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.016495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.016504 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.016565 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.017108 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.017806 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.018695 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.018956 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.019036 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.021454 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:05.021455 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:05.021456 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:05.021462 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:05.023131 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.023461 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.023462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.023463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.023521 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.023698 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.023699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.023699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.023829 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:05.024013 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:05.024052 (+ 39us) server_negotiation.cc:299] Negotiation successful
0929 06:38:05.024124 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:38:05.025179 32251 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } }
I20260929 06:38:05.025354 32251 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c15b393bed4a64a109d51637d7bc72, State: Initialized, Role: FOLLOWER
I20260929 06:38:05.025442 32251 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } }
I20260929 06:38:05.025707 9461 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260929 06:38:05.025722 32257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } } }
I20260929 06:38:05.025750 32251 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:05.025806 32257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:05.026609 32075 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "23144c96e6294ef794aa94e802785ae4"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33988
W20260929 06:38:05.027604 32268 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:38:05.027719 32268 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:38:05.027801 32183 master_runner.cc:186] Error getting master registration for 127.9.61.126:43691: OK, instance_id { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" instance_seqno: 1790663884641084 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 06:38:05.030614 32183 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 06:38:05.045650 32176 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } attempt: 3
Sep 29 06:38:05 dist-test-slave-601b krb5kdc[32020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.125@KRBTEST.COM for kudu/127.9.61.124@KRBTEST.COM
I20260929 06:38:05.052736 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.045978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39226)
0929 06:38:05.046045 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:05.046057 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:05.046103 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:05.046262 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:05.046263 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:05.046459 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:05.046510 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:05.046512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.047152 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.047154 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:05.047679 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:05.047681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.048118 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.048119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:05.048175 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.048670 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:05.048676 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:05.050076 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:05.051560 (+ 1484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:05.051561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:05.051562 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:05.051774 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:05.052024 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:05.052025 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:05.052025 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:05.052085 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:05.052403 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:05.052403 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:05.052450 (+ 47us) client_negotiation.cc:769] Sending connection context
0929 06:38:05.052538 (+ 88us) client_negotiation.cc:240] Negotiation successful
0929 06:38:05.052637 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260929 06:38:05.052736 32255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.046062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39226 (local address 127.9.61.124:42295)
0929 06:38:05.046123 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.046126 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.046147 (+ 21us) server_negotiation.cc:407] Connection header received
0929 06:38:05.046170 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.046171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.046187 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.046244 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.046585 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.047064 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.047775 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.048033 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.048118 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.050178 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:05.050180 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:05.050180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:05.050187 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:05.051475 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.051858 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.051859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.051860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.051915 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.052159 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.052160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.052161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.052308 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:05.052410 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:05.052561 (+ 151us) server_negotiation.cc:299] Negotiation successful
0929 06:38:05.052637 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260929 06:38:05.054104 32176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc: Bootstrap starting.
I20260929 06:38:05.054678 32176 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:05.054929 32176 log.cc:824] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:05.055650 32176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc: No bootstrap required, opened a new log
I20260929 06:38:05.057106 32176 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } }
I20260929 06:38:05.057219 32176 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b06cb5664c944738236040704ec6cbc, State: Initialized, Role: FOLLOWER
I20260929 06:38:05.057281 32176 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } }
I20260929 06:38:05.057535 32271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } } }
I20260929 06:38:05.057616 32176 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:05.057622 32271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [sys.catalog]: This master's current role is: FOLLOWER
W20260929 06:38:05.057865 32129 tablet.cc:2369] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260929 06:38:05.059479 32282 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:38:05.059542 32282 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:38:05.059754 32108 master_runner.cc:186] Error getting master registration for 127.9.61.126:43691: OK, instance_id { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" instance_seqno: 1790663884641084 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260929 06:38:05.061859 32108 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 06:38:05.087514 32101 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } attempt: 3
Sep 29 06:38:05 dist-test-slave-601b krb5kdc[32020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790663884, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.61.126@KRBTEST.COM for kudu/127.9.61.124@KRBTEST.COM
I20260929 06:38:05.095400 32255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.088085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39242 (local address 127.9.61.124:42295)
0929 06:38:05.088144 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.088146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.088163 (+ 17us) server_negotiation.cc:407] Connection header received
0929 06:38:05.088195 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.088195 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.088223 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.088274 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.088616 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.089367 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.090050 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.090350 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.090411 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.092583 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:05.092585 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:05.092585 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:05.092593 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:05.094252 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.094594 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.094596 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.094596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.094652 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.094855 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.094856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.094856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.094988 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:05.095058 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:05.095228 (+ 170us) server_negotiation.cc:299] Negotiation successful
0929 06:38:05.095299 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260929 06:38:05.095400 32104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.087878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.61.124:42295 (local address 127.0.0.1:39242)
0929 06:38:05.087933 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0929 06:38:05.087962 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0929 06:38:05.088014 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0929 06:38:05.088308 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0929 06:38:05.088309 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0929 06:38:05.088479 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0929 06:38:05.088527 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:05.088529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.089438 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.089439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:05.089958 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0929 06:38:05.089959 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.090407 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.090408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0929 06:38:05.090463 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.090953 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0929 06:38:05.090958 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0929 06:38:05.092494 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0929 06:38:05.094340 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:05.094341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:05.094341 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:05.094510 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:05.094733 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0929 06:38:05.094733 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0929 06:38:05.094734 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0929 06:38:05.094786 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0929 06:38:05.095061 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0929 06:38:05.095062 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0929 06:38:05.095104 (+ 42us) client_negotiation.cc:769] Sending connection context
0929 06:38:05.095200 (+ 96us) client_negotiation.cc:240] Negotiation successful
0929 06:38:05.095300 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260929 06:38:05.097535 32101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4: Bootstrap starting.
I20260929 06:38:05.098292 32101 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4: Neither blocks nor log segments found. Creating new log.
I20260929 06:38:05.098599 32101 log.cc:824] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4: Log is configured to *not* fsync() on all Append() calls
I20260929 06:38:05.099417 32101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4: No bootstrap required, opened a new log
I20260929 06:38:05.100787 32101 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } }
I20260929 06:38:05.100925 32101 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23144c96e6294ef794aa94e802785ae4, State: Initialized, Role: FOLLOWER
I20260929 06:38:05.101009 32101 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } }
I20260929 06:38:05.101351 32101 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 06:38:05.101379 32075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 06:38:05.101421 32075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:05.102255 32075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } }
I20260929 06:38:05.102522 32075 leader_election.cc:288] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [CANDIDATE]: Term 1 election: Requested vote from peers 1b06cb5664c944738236040704ec6cbc (127.9.61.125:38005), 55c15b393bed4a64a109d51637d7bc72 (127.9.61.124:42295)
I20260929 06:38:05.102837 32150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23144c96e6294ef794aa94e802785ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1b06cb5664c944738236040704ec6cbc"
I20260929 06:38:05.102969 32150 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:05.103842 32225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "23144c96e6294ef794aa94e802785ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "55c15b393bed4a64a109d51637d7bc72"
I20260929 06:38:05.103936 32150 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23144c96e6294ef794aa94e802785ae4 in term 1.
I20260929 06:38:05.103986 32225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [term 0 FOLLOWER]: Advancing to term 1
I20260929 06:38:05.104194 32051 leader_election.cc:302] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b06cb5664c944738236040704ec6cbc, 23144c96e6294ef794aa94e802785ae4; no voters:
I20260929 06:38:05.104840 32225 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23144c96e6294ef794aa94e802785ae4 in term 1.
W20260929 06:38:05.105332 32301 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260929 06:38:05.105381 32301 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260929 06:38:05.105501 32298 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 06:38:05.105751 32298 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [term 1 LEADER]: Becoming Leader. State: Replica: 23144c96e6294ef794aa94e802785ae4, State: Running, Role: LEADER
I20260929 06:38:05.105866 32298 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } }
I20260929 06:38:05.106346 32298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23144c96e6294ef794aa94e802785ae4. Latest consensus state: current_term: 1 leader_uuid: "23144c96e6294ef794aa94e802785ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } } }
I20260929 06:38:05.106419 32298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:05.107528 32033 master_runner.cc:263] No leader master found from master 23144c96e6294ef794aa94e802785ae4
I20260929 06:38:05.107569 32033 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260929 06:38:05.101320 32285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } } }
I20260929 06:38:05.107751 32285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:05.113619 32305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 06:38:05.113790 32305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 06:38:05.119091 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.108100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53778 (local address 127.9.61.125:38005)
0929 06:38:05.108142 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.108144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.108895 (+ 751us) server_negotiation.cc:407] Connection header received
0929 06:38:05.108999 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.108999 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.109010 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.109041 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.109839 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.110571 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.111608 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.111909 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.111984 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.114596 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:05.114597 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:05.114598 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:05.114605 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:05.116783 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.118186 (+ 1403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.118187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.118188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.118247 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.118465 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.118465 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.118466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.118600 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:05.118672 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:05.118880 (+ 208us) server_negotiation.cc:299] Negotiation successful
0929 06:38:05.118962 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260929 06:38:05.120541 32103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.108349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33990 (local address 127.9.61.126:43691)
0929 06:38:05.108384 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.108386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.112398 (+ 4012us) server_negotiation.cc:407] Connection header received
0929 06:38:05.112493 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.112494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.112505 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.112534 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.113306 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.113987 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.114992 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.115301 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.115346 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.116852 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:05.116853 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:05.116854 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:05.116861 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:05.118549 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.118918 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.118919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.118920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.118971 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.119919 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.119920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.119921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.120087 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:05.120175 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:05.120382 (+ 207us) server_negotiation.cc:299] Negotiation successful
0929 06:38:05.120456 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260929 06:38:05.122207 32225 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [term 1 FOLLOWER]: Refusing update from remote peer 23144c96e6294ef794aa94e802785ae4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:05.122640 32285 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:05.124162 32257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23144c96e6294ef794aa94e802785ae4. Latest consensus state: current_term: 1 leader_uuid: "23144c96e6294ef794aa94e802785ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } } }
I20260929 06:38:05.124253 32257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:05.124727 32150 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [term 1 FOLLOWER]: Refusing update from remote peer 23144c96e6294ef794aa94e802785ae4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 06:38:05.125002 32285 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 06:38:05.125581 32255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:05.108630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39248 (local address 127.9.61.124:42295)
0929 06:38:05.108676 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.108678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.116091 (+ 7413us) server_negotiation.cc:407] Connection header received
0929 06:38:05.116197 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.116198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.116209 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.116240 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.116919 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.117562 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.118526 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:05.118812 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:05.118857 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:05.120846 (+ 1989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0929 06:38:05.120847 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0929 06:38:05.120848 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0929 06:38:05.120855 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0929 06:38:05.122643 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.123129 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.123131 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.123131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.123188 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0929 06:38:05.123397 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0929 06:38:05.123398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0929 06:38:05.123399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0929 06:38:05.123519 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0929 06:38:05.123583 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:05.125401 (+ 1818us) server_negotiation.cc:299] Negotiation successful
0929 06:38:05.125499 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260929 06:38:05.126268 32271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23144c96e6294ef794aa94e802785ae4. Latest consensus state: current_term: 1 leader_uuid: "23144c96e6294ef794aa94e802785ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } } }
I20260929 06:38:05.126345 32271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:05.128450 32285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23144c96e6294ef794aa94e802785ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } } }
I20260929 06:38:05.128530 32285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:05.128983 32271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "23144c96e6294ef794aa94e802785ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } } }
I20260929 06:38:05.129066 32271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:05.129293 32309 mvcc.cc:205] Tried to move back new op lower bound from 7334559273453785088 to 7334559273394536448. Current Snapshot: MvccSnapshot[applied={T|T < 7334559273453785088}]
I20260929 06:38:05.129684 32298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23144c96e6294ef794aa94e802785ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } } }
I20260929 06:38:05.129756 32298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4 [sys.catalog]: This master's current role is: LEADER
I20260929 06:38:05.130103 32257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "23144c96e6294ef794aa94e802785ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23144c96e6294ef794aa94e802785ae4" member_type: VOTER last_known_addr { host: "127.9.61.126" port: 43691 } } peers { permanent_uuid: "1b06cb5664c944738236040704ec6cbc" member_type: VOTER last_known_addr { host: "127.9.61.125" port: 38005 } } peers { permanent_uuid: "55c15b393bed4a64a109d51637d7bc72" member_type: VOTER last_known_addr { host: "127.9.61.124" port: 42295 } } }
I20260929 06:38:05.130177 32257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72 [sys.catalog]: This master's current role is: FOLLOWER
I20260929 06:38:05.130518 32312 mvcc.cc:205] Tried to move back new op lower bound from 7334559273453785088 to 7334559273394536448. Current Snapshot: MvccSnapshot[applied={T|T < 7334559273453785088}]
I20260929 06:38:05.130964 32310 mvcc.cc:205] Tried to move back new op lower bound from 7334559273453785088 to 7334559273394536448. Current Snapshot: MvccSnapshot[applied={T|T < 7334559273453785088}]
I20260929 06:38:05.131439 32305 catalog_manager.cc:1347] Generated new cluster ID: bb9dcd7ec01d4b11b6f04e27099afd64
I20260929 06:38:05.131496 32305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 06:38:05.148959 32305 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 06:38:05.149760 32305 catalog_manager.cc:1504] Loading token signing keys...
I20260929 06:38:05.166872 32305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23144c96e6294ef794aa94e802785ae4: Generated new TSK 0
I20260929 06:38:05.167083 32305 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260929 06:38:05.194828 32180 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.193237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53780 (local address 127.9.61.125:38005)
0929 06:38:05.193281 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.193283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.194191 (+ 908us) server_negotiation.cc:407] Connection header received
0929 06:38:05.194298 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.194299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.194310 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.194340 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.194760 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53780: BlockingRecv error: recv got EOF from 127.0.0.1:53780 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260929 06:38:05.195643 32103 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.193641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34000 (local address 127.9.61.126:43691)
0929 06:38:05.193682 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.193684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.195081 (+ 1397us) server_negotiation.cc:407] Connection header received
0929 06:38:05.195193 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.195194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.195205 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.195236 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.195585 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34000: BlockingRecv error: recv got EOF from 127.0.0.1:34000 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 06:38:05.196414 32255 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.193944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39256 (local address 127.9.61.124:42295)
0929 06:38:05.194013 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.194015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.195843 (+ 1828us) server_negotiation.cc:407] Connection header received
0929 06:38:05.195918 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.195920 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.195934 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.196035 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.196337 (+ 302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39256: BlockingRecv error: recv got EOF from 127.0.0.1:39256 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260929 06:38:05.198426 32180 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.197687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53784 (local address 127.9.61.125:38005)
0929 06:38:05.197721 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.197722 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.197911 (+ 189us) server_negotiation.cc:407] Connection header received
0929 06:38:05.198013 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.198014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.198031 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.198060 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.198374 (+ 314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53784: BlockingRecv error: recv got EOF from 127.0.0.1:53784 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 06:38:05.201473 32180 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.200660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53788 (local address 127.9.61.125:38005)
0929 06:38:05.200691 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.200710 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.200953 (+ 243us) server_negotiation.cc:407] Connection header received
0929 06:38:05.201045 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.201046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.201055 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.201083 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.201429 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53788: BlockingRecv error: recv got EOF from 127.0.0.1:53788 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 06:38:05.205305 32180 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.204571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53800 (local address 127.9.61.125:38005)
0929 06:38:05.204604 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.204606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.204838 (+ 232us) server_negotiation.cc:407] Connection header received
0929 06:38:05.204929 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.204930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.204939 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.204966 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.205264 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53800: BlockingRecv error: recv got EOF from 127.0.0.1:53800 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260929 06:38:05.211037 32180 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.210389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53812 (local address 127.9.61.125:38005)
0929 06:38:05.210423 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.210425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.210563 (+ 138us) server_negotiation.cc:407] Connection header received
0929 06:38:05.210609 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.210609 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.210623 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.210686 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.210988 (+ 302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53812: BlockingRecv error: recv got EOF from 127.0.0.1:53812 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260929 06:38:05.220707 32180 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.220111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53824 (local address 127.9.61.125:38005)
0929 06:38:05.220150 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.220152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.220166 (+ 14us) server_negotiation.cc:407] Connection header received
0929 06:38:05.220249 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.220250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.220261 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.220327 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.220658 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53824: BlockingRecv error: recv got EOF from 127.0.0.1:53824 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260929 06:38:05.238691 32180 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.237874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53836 (local address 127.9.61.125:38005)
0929 06:38:05.237917 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.237919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.238093 (+ 174us) server_negotiation.cc:407] Connection header received
0929 06:38:05.238131 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.238132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.238145 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.238215 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.238633 (+ 418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53836: BlockingRecv error: recv got EOF from 127.0.0.1:53836 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260929 06:38:05.272615 32180 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.271894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53848 (local address 127.9.61.125:38005)
0929 06:38:05.271978 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.271980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.272077 (+ 97us) server_negotiation.cc:407] Connection header received
0929 06:38:05.272147 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.272148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.272163 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.272232 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.272555 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53848: BlockingRecv error: recv got EOF from 127.0.0.1:53848 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260929 06:38:05.338541 32180 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.337931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53860 (local address 127.9.61.125:38005)
0929 06:38:05.338002 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.338004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.338087 (+ 83us) server_negotiation.cc:407] Connection header received
0929 06:38:05.338136 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.338137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.338147 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.338213 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.338492 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53860: BlockingRecv error: recv got EOF from 127.0.0.1:53860 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260929 06:38:05.468684 32180 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.467843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53872 (local address 127.9.61.125:38005)
0929 06:38:05.467933 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.467935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.468060 (+ 125us) server_negotiation.cc:407] Connection header received
0929 06:38:05.468179 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.468180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.468208 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.468276 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.468620 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53872: BlockingRecv error: recv got EOF from 127.0.0.1:53872 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260929 06:38:05.726626 32180 negotiation.cc:337] Failed RPC negotiation. Trace:
0929 06:38:05.725837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53882 (local address 127.9.61.125:38005)
0929 06:38:05.725928 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:05.725929 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:05.725961 (+ 32us) server_negotiation.cc:407] Connection header received
0929 06:38:05.726037 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:05.726038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:05.726050 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:05.726104 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0929 06:38:05.726544 (+ 440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53882: BlockingRecv error: recv got EOF from 127.0.0.1:53882 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260929 06:38:06.028189 32268 catalog_manager.cc:1259] Loaded cluster ID: bb9dcd7ec01d4b11b6f04e27099afd64
I20260929 06:38:06.028293 32268 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72: loading cluster ID for follower catalog manager: success
I20260929 06:38:06.029099 32268 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72: acquiring CA information for follower catalog manager: success
I20260929 06:38:06.029430 32268 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 55c15b393bed4a64a109d51637d7bc72: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:38:06.059993 32282 catalog_manager.cc:1259] Loaded cluster ID: bb9dcd7ec01d4b11b6f04e27099afd64
I20260929 06:38:06.060066 32282 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc: loading cluster ID for follower catalog manager: success
I20260929 06:38:06.060822 32282 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc: acquiring CA information for follower catalog manager: success
I20260929 06:38:06.061065 32282 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1b06cb5664c944738236040704ec6cbc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260929 06:38:06.242242 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:06.239791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53888 (local address 127.9.61.125:38005)
0929 06:38:06.239988 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:06.239990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:06.240007 (+ 17us) server_negotiation.cc:407] Connection header received
0929 06:38:06.240033 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:06.240034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:06.240082 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:06.240154 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:06.240299 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:06.240791 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:06.241518 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:06.241701 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:06.241750 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:06.241904 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:06.242012 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:06.242070 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:06.242103 (+ 33us) server_negotiation.cc:299] Negotiation successful
0929 06:38:06.242120 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":64,"threads_started":1}
I20260929 06:38:06.246325 32387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:06.244125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39264 (local address 127.9.61.124:42295)
0929 06:38:06.244231 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:06.244233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:06.244243 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:06.244281 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:06.244282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:06.244314 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:06.244385 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:06.244475 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:06.244950 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:06.245615 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:06.245802 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:06.245851 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:06.245978 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:06.246076 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:06.246134 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:06.246169 (+ 35us) server_negotiation.cc:299] Negotiation successful
0929 06:38:06.246187 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":61,"threads_started":1}
I20260929 06:38:06.250712 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:06.247999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53894 (local address 127.9.61.125:38005)
0929 06:38:06.248043 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:06.248045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:06.248206 (+ 161us) server_negotiation.cc:407] Connection header received
0929 06:38:06.248390 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:06.248391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:06.248404 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:06.248451 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:06.248587 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:06.249093 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:06.249947 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:06.250230 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:06.250294 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:06.250449 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:06.250483 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:06.250536 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:06.250605 (+ 69us) server_negotiation.cc:299] Negotiation successful
0929 06:38:06.250631 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260929 06:38:06.251068 32387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:06.248338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39280 (local address 127.9.61.124:42295)
0929 06:38:06.248377 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:06.248379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:06.248387 (+ 8us) server_negotiation.cc:407] Connection header received
0929 06:38:06.248448 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:06.248449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:06.248457 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:06.248512 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:06.248680 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:06.249181 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:06.250259 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:06.250594 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:06.250651 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:06.250829 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:06.250860 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:06.250886 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:06.250985 (+ 99us) server_negotiation.cc:299] Negotiation successful
0929 06:38:06.251007 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260929 06:38:06.252069 32394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0929 06:38:06.248018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34012 (local address 127.9.61.126:43691)
0929 06:38:06.248135 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0929 06:38:06.248137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0929 06:38:06.248147 (+ 10us) server_negotiation.cc:407] Connection header received
0929 06:38:06.248241 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0929 06:38:06.248242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0929 06:38:06.248293 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0929 06:38:06.248438 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0929 06:38:06.249173 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:06.250021 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:06.251044 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0929 06:38:06.251448 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0929 06:38:06.251520 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0929 06:38:06.251697 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0929 06:38:06.251801 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0929 06:38:06.251850 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0929 06:38:06.251906 (+ 56us) server_negotiation.cc:299] Negotiation successful
0929 06:38:06.251925 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":60,"threads_started":1}
I20260929 06:38:06.257030 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 32033
I20260929 06:38:06.263106 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 32108
I20260929 06:38:06.268071 9461 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskA6qGeu/build/release/bin/kudu with pid 32183
2026-09-29T06:38:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2894 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5833 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (265075 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST